Apr 21 20:48:44 devstack cinder-volume[72380]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:48:44 devstack cinder-volume[72380]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:48:44 devstack cinder-volume[72380]: we strongly recommend against using it for new projects. Apr 21 20:48:44 devstack cinder-volume[72380]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:48:44 devstack cinder-volume[72380]: framework. For more detail see Apr 21 20:48:44 devstack cinder-volume[72380]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:48:44 devstack cinder-volume[72380]: import eventlet # noqa Apr 21 20:48:46 devstack cinder-volume[72380]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:48:46 devstack cinder-volume[72380]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:48:46 devstack cinder-volume[72380]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:48:47 devstack cinder-volume[72380]: INFO dbcounter [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Registered counter for database cinder Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_db.sqlalchemy.engines [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG dbcounter [-] [72380] Writer thread running {{(pid=72380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.rpc [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.rpc [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_db.sqlalchemy.engines [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.volume.manager [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Determined volume DB was empty at startup. Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG cinder.volume.manager [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72380) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.volume.manager [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:48:47 devstack cinder-volume[72380]: WARNING stevedore.named [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:48:47 devstack cinder-volume[72380]: WARNING castellan.key_manager [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:48:47 devstack cinder-volume[72380]: WARNING cinder.keymgr.conf_key_mgr [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG cinder.volume.drivers.lvm [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72380) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_concurrency.processutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_concurrency.processutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.286s {{(pid=72380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_db.sqlalchemy.engines [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.rpc [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.rpc [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 21 20:48:47 devstack cinder-volume[72380]: WARNING stevedore.named [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:48:47 devstack cinder-volume[72380]: WARNING castellan.key_manager [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:48:47 devstack cinder-volume[72380]: INFO cinder.volume.manager [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_db.sqlalchemy.engines [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:48:47 devstack cinder-volume[72380]: INFO oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Starting 1 workers Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Started child 72493 {{(pid=72380) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Full set of CONF: {{(pid=72380) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] ******************************************************************************** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Configuration options gathered from: {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] ================================================================================ {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] allow_availability_zone_fallback = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] allow_compression_on_image_upload = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72493]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] allowed_direct_url_schemes = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] api_rate_limit = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] auth_strategy = keystone {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] az_cache_duration = 3600 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_availability_zone = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_host = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_stats_polling_interval = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backup_api_class = cinder.backup.api.API {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backup_name_template = backup-%s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backup_use_same_host = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backup_use_temp_snapshot = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] chap_password = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] chap_username = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_internal_tenant_project_id = 72b4fb37cf984d669e257f43b0c9f33b {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_internal_tenant_user_id = d5a42f172c874f78a60bbf769f7c3cce {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cloned_volume_same_az = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cluster = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] compression_format = gzip {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] compute_api_class = cinder.compute.nova.API {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] config_dir = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] config_source = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] control_exchange = openstack {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] debug = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] default_availability_zone = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] default_group_type = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] default_volume_type = lvmdriver-1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] disk_geometry = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] driver_client_cert = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] driver_client_cert_key = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] driver_data_namespace = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] driver_ssl_cert_path = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] driver_ssl_cert_verify = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] driver_use_ssl = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] enable_force_upload = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] enable_new_services = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] enable_unsupported_driver = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] enforce_multipath_for_image_xfer = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] filter_function = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_api_insecure = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_api_ssl_compression = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_ca_certificates_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_catalog_info = image:glance:publicURL {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_num_retries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance_request_timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] goodness_function = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] graceful_shutdown_timeout = 5 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] group_api_class = cinder.group.api.API {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] host = devstack {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_compress_on_upload = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_conversion_address_space_limit = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_conversion_cpu_limit = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_conversion_disable = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_upload_use_cinder_backend = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_upload_use_internal_tenant = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_volume_cache_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_volume_cache_max_count = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] image_volume_cache_max_size_gb = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] init_host_max_objects_retrieval = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] instance_format = [instance: %(uuid)s] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] iscsi_target_flags = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] iscsi_write_cache = on {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] iser_helper = tgtadm {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] iser_ip_address = 192.168.122.249 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] iser_port = 3260 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_color = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_config_append = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_dir = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_options = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_rotate_interval = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_rotate_interval_type = days {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] log_rotation_type = none {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] max_age = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] max_logfile_count = 30 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] max_logfile_size_mb = 200 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] max_over_subscription_ratio = 20.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] message_reap_interval = 86400 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] message_ttl = 2592000 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] migration_create_volume_timeout_secs = 300 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] monkey_patch = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] monkey_patch_modules = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] my_ip = 192.168.122.249 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] no_snapshot_gb_quota = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] num_iser_scan_tries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] num_shell_tries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] num_volume_device_scan_tries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] nvmeof_conn_info_version = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] nvmet_ns_id = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] nvmet_port_id = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_max_limit = 1000 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_volume_ext_list = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_volume_listen_port = 8776 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_volume_use_ssl = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] osapi_volume_workers = 2 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] per_volume_size_limit = -1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] periodic_fuzzy_delay = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] periodic_interval = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] public_endpoint = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] publish_errors = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_backup_gigabytes = 1000 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_backups = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_gigabytes = 1000 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_groups = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_snapshots = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] quota_volumes = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] rate_limit_burst = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] rate_limit_except_level = CRITICAL {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] rate_limit_interval = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72493]: INFO cinder.volume.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] reinit_driver_count = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] replication_device = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] report_discard_supported = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] report_interval = 120 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] reservation_clean_interval = 86400 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] reservation_expire = 86400 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] reserved_image_namespaces = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] reserved_percentage = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] rpc_response_timeout = 120 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] run_external_periodic_tasks = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] scst_target_driver = iscsi {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] scst_target_iqn_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_down_time = 720 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] shell_completion = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] snapshot_name_template = snapshot-%s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] snapshot_same_host = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] split_loggers = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] state_path = /opt/stack/data/cinder {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] storage_availability_zone = nova {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] storage_protocol = iSCSI {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] syslog_log_facility = LOG_USER {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] target_helper = lioadm {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] target_ip_address = 192.168.122.249 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] target_port = 3260 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] target_protocol = iscsi {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] target_secondary_ip_addresses = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] trace_flags = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] transport_url = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] until_refresh = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_chap_auth = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_default_quota_class = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_journal = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_json = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_multipath_for_image_xfer = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_stderr = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] use_syslog = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] verify_glance_signatures = enabled {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_api_class = cinder.volume.api.API {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_backend_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_clear = zero {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_clear_ionice = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_clear_size = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_copy_bps_limit = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_dd_blocksize = 1M {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_name_template = volume-%s {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_service_inithost_offload = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volume_usage_audit_period = month {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] zoning_mode = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.admin_password = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.admin_token = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.admin_user = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_port = 35357 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_protocol = https {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_section = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_type = password {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_uri = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.auth_version = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.cache = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.identity_uri = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.include_service_catalog = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.insecure = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.interface = public {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_password = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcache_username = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.region_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.service_type = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.backend = dogpile.cache.null {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.backend_argument = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.backend_expiration_time = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.config_prefix = cache.oslo {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.debug_cache_backend = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.enable_retry_client = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.enable_socket_keepalive = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.enforce_fips_mode = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:47 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.expiration_time = 600 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_dead_retry = 300 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_pool_maxsize = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_sasl_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.password = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.proxies = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.redis_db = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.redis_server = localhost:6379 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.retry_attempts = 2 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.retry_delay = 0.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.socket_keepalive_count = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.socket_keepalive_idle = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.socket_keepalive_interval = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.socket_timeout = 1.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.tls_allowed_ciphers = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.tls_cafile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.tls_certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.tls_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.tls_keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cache.username = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] coordination.backend_url = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.asyncio_connection = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.asyncio_slave_connection = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.backend = sqlalchemy {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.connection = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.connection_debug = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.connection_parameters = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.connection_recycle_time = 3600 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.connection_trace = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.db_inc_retry_interval = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.db_max_retries = 20 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.db_max_retry_interval = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.db_retry_interval = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.max_overflow = 50 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.max_pool_size = 5 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.max_retries = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.pool_timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.retry_interval = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.slave_connection = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.sqlite_synchronous = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.synchronous_reader = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] database.use_db_reconnect = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.connection_string = messaging:// {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.es_doc_type = notification {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.es_scroll_size = 10000 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.es_scroll_time = 2m {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.filter_error_trace = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.hmac_keys = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.sentinel_service_name = mymaster {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.socket_timeout = 0.1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.trace_requests = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler.trace_sqlalchemy = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler_jaeger.process_tags = {} {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler_jaeger.service_name_prefix = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] profiler_otlp.service_name_prefix = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.enforce_new_defaults = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: WARNING oslo_config.cfg [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.enforce_scope = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.policy_default_rule = default {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.policy_file = policy.yaml {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.group = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.helper_command = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] privsep_osbrick.user = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.group = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.helper_command = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] cinder_sys_admin.user = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.auth_section = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.auth_type = password {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.cafile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.collect_timing = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.insecure = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.send_service_user_token = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.split_loggers = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] service_user.timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.auth_section = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.auth_type = password {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.collect_timing = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.insecure = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.region_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.split_loggers = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] glance.timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.backend_availability_zone = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.chap_password = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.chap_username = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.disk_geometry = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.driver_client_cert = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.driver_client_cert_key = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.driver_data_namespace = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.driver_use_ssl = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.extra_capabilities = {} {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.filter_function = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.goodness_function = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.iscsi_target_flags = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.iscsi_write_cache = on {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.iser_helper = tgtadm {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.iser_port = 3260 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.lvm_share_target = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.lvm_type = auto {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.num_shell_tries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.replication_device = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.report_discard_supported = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.reserved_percentage = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.target_helper = tgtadm {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.target_port = 3260 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.target_protocol = iscsi {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.trace_flags = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.unique_fqdn_network = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.use_chap_auth = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_backend_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_clear = zero {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_clear_ionice = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_clear_size = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_reports.file_event_handler = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_reports.log_dir = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.backend_host = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.chap_password = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.chap_username = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.disk_geometry = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.driver_client_cert = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.extra_capabilities = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.filter_function = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.goodness_function = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.iser_helper = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.iser_ip_address = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.iser_port = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.lvm_share_target = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.lvm_type = auto {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.num_shell_tries = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.replication_device = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.report_discard_supported = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.reserved_percentage = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.scst_target_driver = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.storage_protocol = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.target_helper = lioadm {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.target_ip_address = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.target_port = 3260 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.trace_flags = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.use_chap_auth = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_clear = zero {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_clear_size = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] lvmdriver-1.volumes_dir = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.ssl = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_notifications.driver = [] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] key_manager.fixed_key = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.barbican_api_version = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.barbican_endpoint = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.barbican_endpoint_type = public {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.barbican_region_name = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.cafile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.collect_timing = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.insecure = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.number_of_retries = 60 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.retry_delay = 1 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.send_service_user_token = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.split_loggers = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.verify_ssl = True {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican.verify_ssl_path = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.auth_section = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.auth_type = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.cafile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.certfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.collect_timing = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.insecure = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.keyfile = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.split_loggers = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] barbican_service_user.timeout = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.approle_role_id = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.approle_secret_id = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.kv_mountpoint = secret {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.kv_path = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.kv_version = 2 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.namespace = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.root_token_id = **** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.ssl_ca_crt_file = None {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.timeout = 60.0 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack sudo[72497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.use_ssl = False {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:48:48 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] ******************************************************************************** {{(pid=72380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:48:48 devstack sudo[72497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:48 devstack sudo[72497]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:48 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:48 devstack sudo[72685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:48 devstack sudo[72685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:49 devstack sudo[72685]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.477s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:48:49 devstack cinder-volume[72493]: INFO cinder.brick.local_dev.lvm [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:49 devstack sudo[72941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:49 devstack sudo[72941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:49 devstack sudo[72941]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG cinder.brick.local_dev.lvm [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72493) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 21 20:48:49 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:49 devstack sudo[73017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:49 devstack sudo[73017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:50 devstack sudo[73017]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.777s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:50 devstack sudo[73179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:50 devstack sudo[73179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:50 devstack sudo[73179]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:50 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:50 devstack sudo[73183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 21 20:48:50 devstack sudo[73183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:51 devstack sudo[73183]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:51 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.471s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:51 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:51 devstack sudo[73189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:51 devstack sudo[73189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:51 devstack sudo[73189]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:51 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:51 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:51 devstack sudo[73197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:51 devstack sudo[73197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:52 devstack sudo[73197]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:52 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:52 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:52 devstack sudo[73200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:52 devstack sudo[73200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:52 devstack sudo[73200]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:52 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:52 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:52 devstack sudo[73205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:52 devstack sudo[73205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:53 devstack sudo[73205]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:53 devstack sudo[73209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:53 devstack sudo[73209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:53 devstack sudo[73209]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:53 devstack cinder-volume[72493]: INFO cinder.volume.drivers.lvm [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:53 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:53 devstack sudo[73222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:53 devstack sudo[73222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:54 devstack sudo[73222]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:54 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.423s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:54 devstack cinder-volume[72493]: DEBUG cinder.volume.drivers.lvm [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Updating volume stats {{(pid=72493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:48:54 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:54 devstack sudo[73335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:54 devstack sudo[73335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:54 devstack sudo[73335]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:54 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:54 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:54 devstack sudo[73339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:54 devstack sudo[73339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:55 devstack sudo[73339]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:55 devstack sudo[73477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:55 devstack sudo[73477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:55 devstack sudo[73477]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:55 devstack sudo[73480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:55 devstack sudo[73480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:55 devstack sudo[73480]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:55 devstack cinder-volume[72493]: INFO cinder.volume.driver [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG cinder.volume.driver [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72493) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG dbcounter [-] [72493] Writer thread running {{(pid=72493) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG cinder.db.sqlalchemy.api [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Building query based on filter {{(pid=72493) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG cinder.image.image_utils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72493) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:48:55 devstack cinder-volume[72493]: INFO cinder.keymgr.migration [None req-8a788e57-9272-4cdc-abe7-fe4f38a99e98 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG cinder.volume.drivers.lvm [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Updating volume stats {{(pid=72493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:48:55 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:55 devstack sudo[73489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:55 devstack sudo[73489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:56 devstack sudo[73489]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:56 devstack sudo[73492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:56 devstack sudo[73492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:56 devstack sudo[73492]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:56 devstack sudo[73495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:56 devstack sudo[73495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:57 devstack sudo[73495]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.527s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:57 devstack sudo[73500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:57 devstack sudo[73500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:57 devstack sudo[73500]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG cinder.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Notifying Schedulers of capabilities ... {{(pid=72493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:48:57 devstack cinder-volume[72380]: DEBUG dbcounter [-] [72380] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:48:57 devstack cinder-volume[72493]: INFO cinder.volume.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Driver initialization completed successfully. Apr 21 20:48:57 devstack cinder-volume[72493]: INFO cinder.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Initiating service 2 cleanup Apr 21 20:48:57 devstack cinder-volume[72493]: INFO cinder.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Service 2 cleanup completed. Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG cinder.service [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Creating RPC server for service cinder-volume {{(pid=72493) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG cinder.service [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72493) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:48:57 devstack cinder-volume[72493]: INFO cinder.volume.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG cinder.volume.drivers.lvm [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Updating volume stats {{(pid=72493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:48:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:57 devstack sudo[73508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:57 devstack sudo[73508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:58 devstack sudo[73508]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:58 devstack sudo[73513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:58 devstack sudo[73513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:58 devstack sudo[73513]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:58 devstack sudo[73516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:58 devstack sudo[73516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:59 devstack sudo[73516]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:59 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:59 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:59 devstack sudo[73594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:59 devstack sudo[73594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:59 devstack sudo[73594]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:59 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:59 devstack cinder-volume[72493]: INFO cinder.volume.manager [None req-1c2b0b2a-9a4d-4e0f-b79c-52fb90a68e5f None None] Driver post RPC initialization completed successfully. Apr 21 20:49:09 devstack cinder-volume[72493]: DEBUG dbcounter [-] [72493] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72493) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:09 devstack cinder-volume[72493]: DEBUG dbcounter [-] [72493] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=72493) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:56 devstack cinder-volume[72493]: DEBUG oslo_service.periodic_task [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72493) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:49:56 devstack cinder-volume[72493]: DEBUG cinder.volume.drivers.lvm [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Updating volume stats {{(pid=72493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:49:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:56 devstack sudo[78304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:49:56 devstack sudo[78304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:57 devstack sudo[78304]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:57 devstack sudo[78308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:57 devstack sudo[78308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:57 devstack sudo[78308]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:57 devstack sudo[78311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:49:57 devstack sudo[78311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:58 devstack sudo[78311]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:58 devstack sudo[78315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:58 devstack sudo[78315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:58 devstack sudo[78315]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:58 devstack cinder-volume[72493]: DEBUG cinder.manager [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Notifying Schedulers of capabilities ... {{(pid=72493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:56 devstack cinder-volume[72493]: DEBUG oslo_service.periodic_task [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72493) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:50:56 devstack cinder-volume[72493]: DEBUG cinder.volume.drivers.lvm [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Updating volume stats {{(pid=72493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:50:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:56 devstack sudo[79458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:50:56 devstack sudo[79458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:57 devstack sudo[79458]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:57 devstack sudo[79473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:50:57 devstack sudo[79473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:57 devstack sudo[79473]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:57 devstack sudo[79498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:50:57 devstack sudo[79498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:58 devstack sudo[79498]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:58 devstack sudo[79528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:50:58 devstack sudo[79528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:58 devstack sudo[79528]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:58 devstack cinder-volume[72493]: DEBUG cinder.manager [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Notifying Schedulers of capabilities ... {{(pid=72493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:09 devstack cinder-volume[72493]: DEBUG dbcounter [-] [72493] Writing DB stats cinder:SELECT=1 {{(pid=72493) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:09 devstack cinder-volume[72493]: DEBUG dbcounter [-] [72493] Writing DB stats cinder:UPDATE=1 {{(pid=72493) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:56 devstack cinder-volume[72493]: DEBUG oslo_service.periodic_task [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72493) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:51:56 devstack cinder-volume[72493]: DEBUG cinder.volume.drivers.lvm [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Updating volume stats {{(pid=72493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:51:56 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:56 devstack sudo[81038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:51:56 devstack sudo[81038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:57 devstack sudo[81038]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:57 devstack sudo[81065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:51:57 devstack sudo[81065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:57 devstack sudo[81065]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:57 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:57 devstack sudo[81071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:51:57 devstack sudo[81071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:58 devstack sudo[81071]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:58 devstack sudo[81074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:51:58 devstack sudo[81074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:58 devstack sudo[81074]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:58 devstack cinder-volume[72493]: DEBUG oslo_concurrency.processutils [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72493) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:58 devstack cinder-volume[72493]: DEBUG cinder.manager [None req-1d0544f4-ab1d-4862-acec-572594642732 None None] Notifying Schedulers of capabilities ... {{(pid=72493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:16 devstack cinder-volume[72380]: INFO oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Caught SIGTERM, stopping children Apr 21 20:52:16 devstack cinder-volume[72380]: DEBUG oslo_concurrency.lockutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Acquiring lock "singleton_lock" {{(pid=72380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:52:16 devstack cinder-volume[72380]: DEBUG oslo_concurrency.lockutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Acquired lock "singleton_lock" {{(pid=72380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:52:16 devstack cinder-volume[72380]: DEBUG oslo_concurrency.lockutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Releasing lock "singleton_lock" {{(pid=72380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:52:16 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Stop services. {{(pid=72380) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:52:16 devstack cinder-volume[72380]: DEBUG oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Killing children. {{(pid=72380) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:52:16 devstack cinder-volume[72380]: INFO oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Waiting on 1 children to exit Apr 21 20:52:17 devstack cinder-volume[72493]: DEBUG oslo_concurrency.lockutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Acquiring lock "singleton_lock" {{(pid=72493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:52:17 devstack cinder-volume[72493]: DEBUG oslo_concurrency.lockutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Acquired lock "singleton_lock" {{(pid=72493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:52:17 devstack cinder-volume[72493]: DEBUG oslo_concurrency.lockutils [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Releasing lock "singleton_lock" {{(pid=72493) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:52:17 devstack cinder-volume[72493]: WARNING amqp [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:52:17 devstack cinder-volume[72493]: WARNING amqp [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:52:17 devstack cinder-volume[72380]: INFO oslo_service.backend._eventlet.service [None req-526b566f-7966-42b4-b9d9-3d026b4cb6b8 None None] Child 72493 exited with status 0 Apr 21 20:52:18 devstack cinder-volume[81548]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:52:18 devstack cinder-volume[81548]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:52:18 devstack cinder-volume[81548]: we strongly recommend against using it for new projects. Apr 21 20:52:18 devstack cinder-volume[81548]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:52:18 devstack cinder-volume[81548]: framework. For more detail see Apr 21 20:52:18 devstack cinder-volume[81548]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:52:18 devstack cinder-volume[81548]: import eventlet # noqa Apr 21 20:52:20 devstack cinder-volume[81548]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81548) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:52:20 devstack cinder-volume[81548]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81548) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:52:20 devstack cinder-volume[81548]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81548) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:52:20 devstack cinder-volume[81548]: INFO dbcounter [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Registered counter for database cinder Apr 21 20:52:20 devstack cinder-volume[81548]: DEBUG oslo_db.sqlalchemy.engines [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81548) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG dbcounter [-] [81548] Writer thread running {{(pid=81548) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:52:21 devstack cinder-volume[81548]: INFO cinder.rpc [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:52:21 devstack cinder-volume[81548]: INFO cinder.rpc [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_db.sqlalchemy.engines [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81548) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:21 devstack cinder-volume[81548]: INFO cinder.volume.manager [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Determined volume DB was empty at startup. Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG cinder.volume.manager [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81548) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:52:21 devstack cinder-volume[81548]: INFO cinder.volume.manager [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:52:21 devstack cinder-volume[81548]: WARNING stevedore.named [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:52:21 devstack cinder-volume[81548]: WARNING castellan.key_manager [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:52:21 devstack cinder-volume[81548]: WARNING cinder.keymgr.conf_key_mgr [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:52:21 devstack cinder-volume[81548]: INFO cinder.volume.manager [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_db.sqlalchemy.engines [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81548) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:21 devstack cinder-volume[81548]: INFO oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Starting 1 workers Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Started child 81665 {{(pid=81548) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Full set of CONF: {{(pid=81548) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] ******************************************************************************** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Configuration options gathered from: {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] ================================================================================ {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] allow_availability_zone_fallback = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] allow_compression_on_image_upload = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] allowed_direct_url_schemes = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] api_rate_limit = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] auth_strategy = keystone {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_availability_zone = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_host = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_stats_polling_interval = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backup_api_class = cinder.backup.api.API {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backup_name_template = backup-%s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backup_use_same_host = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backup_use_temp_snapshot = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] chap_password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] chap_username = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_internal_tenant_project_id = 72b4fb37cf984d669e257f43b0c9f33b {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_internal_tenant_user_id = d5a42f172c874f78a60bbf769f7c3cce {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cluster = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] compression_format = gzip {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] compute_api_class = cinder.compute.nova.API {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] config_dir = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] config_source = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] control_exchange = openstack {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] debug = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] default_availability_zone = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] default_group_type = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] default_volume_type = QuobyteHD {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] disk_geometry = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] driver_client_cert = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] driver_client_cert_key = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] driver_data_namespace = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] driver_ssl_cert_path = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] driver_ssl_cert_verify = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] driver_use_ssl = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] enable_new_services = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] enable_unsupported_driver = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] enabled_backends = ['QuobyteHD'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] enforce_multipath_for_image_xfer = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] filter_function = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_api_insecure = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_api_ssl_compression = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_ca_certificates_file = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_catalog_info = image:glance:publicURL {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_num_retries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance_request_timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] goodness_function = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] graceful_shutdown_timeout = 5 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] group_api_class = cinder.group.api.API {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] host = devstack {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_compress_on_upload = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_conversion_address_space_limit = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_conversion_cpu_limit = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81665]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_conversion_disable = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_upload_use_cinder_backend = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_upload_use_internal_tenant = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_volume_cache_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_volume_cache_max_count = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] image_volume_cache_max_size_gb = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] init_host_max_objects_retrieval = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] instance_format = [instance: %(uuid)s] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] iscsi_target_flags = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] iscsi_write_cache = on {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] iser_helper = tgtadm {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] iser_ip_address = 192.168.122.249 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] iser_port = 3260 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_color = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_config_append = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_dir = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_file = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_options = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_rotate_interval = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_rotate_interval_type = days {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] log_rotation_type = none {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] max_age = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] max_logfile_count = 30 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] max_logfile_size_mb = 200 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] max_over_subscription_ratio = 20.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] message_reap_interval = 86400 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] message_ttl = 2592000 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] migration_create_volume_timeout_secs = 300 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] monkey_patch = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] monkey_patch_modules = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] my_ip = 192.168.122.249 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] no_snapshot_gb_quota = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] num_iser_scan_tries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] num_shell_tries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] num_volume_device_scan_tries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] nvmeof_conn_info_version = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] nvmet_ns_id = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] nvmet_port_id = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_max_limit = 1000 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_volume_ext_list = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_volume_listen_port = 8776 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_volume_use_ssl = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] osapi_volume_workers = 2 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] per_volume_size_limit = -1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] periodic_fuzzy_delay = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] periodic_interval = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] public_endpoint = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] publish_errors = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_backup_gigabytes = 1000 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_backups = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_gigabytes = 1000 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_groups = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_snapshots = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] quota_volumes = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] rate_limit_burst = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] rate_limit_except_level = CRITICAL {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] rate_limit_interval = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] reinit_driver_count = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] replication_device = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] report_discard_supported = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] report_interval = 120 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] reservation_clean_interval = 86400 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] reservation_expire = 86400 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] reserved_image_namespaces = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] reserved_percentage = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] rpc_response_timeout = 120 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] run_external_periodic_tasks = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] scst_target_driver = iscsi {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] scst_target_iqn_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_down_time = 720 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] shell_completion = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] snapshot_name_template = snapshot-%s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] split_loggers = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] state_path = /opt/stack/data/cinder {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] storage_availability_zone = nova {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] storage_protocol = iSCSI {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] syslog_log_facility = LOG_USER {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] target_helper = lioadm {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] target_ip_address = 192.168.122.249 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] target_port = 3260 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] target_protocol = iscsi {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] target_secondary_ip_addresses = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] trace_flags = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] transport_url = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] until_refresh = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_chap_auth = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_default_quota_class = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_journal = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_json = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_multipath_for_image_xfer = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_stderr = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] use_syslog = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] verify_glance_signatures = enabled {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_api_class = cinder.volume.api.API {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_backend_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_clear = zero {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_clear_ionice = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_clear_size = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_copy_bps_limit = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_dd_blocksize = 1M {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_name_template = volume-%s {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_service_inithost_offload = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volume_usage_audit_period = month {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] zoning_mode = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_concurrency.disable_process_locking = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.admin_password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.admin_token = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.admin_user = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_port = 35357 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_protocol = https {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_section = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_type = password {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_uri = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.auth_version = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.cache = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.identity_uri = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.include_service_catalog = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.insecure = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.interface = public {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_password = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcache_username = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.region_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.service_type = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.backend = dogpile.cache.null {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.backend_argument = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.backend_expiration_time = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.config_prefix = cache.oslo {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.debug_cache_backend = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.enable_retry_client = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.enable_socket_keepalive = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.enforce_fips_mode = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.expiration_time = 600 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.hashclient_retry_attempts = 2 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_dead_retry = 300 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_pool_maxsize = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_sasl_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.proxies = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.redis_db = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.redis_server = localhost:6379 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.retry_attempts = 2 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.retry_delay = 0.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.socket_keepalive_count = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.socket_keepalive_idle = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.socket_keepalive_interval = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.socket_timeout = 1.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.tls_allowed_ciphers = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.tls_cafile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.tls_certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.tls_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.tls_keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cache.username = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] coordination.backend_url = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.asyncio_connection = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.asyncio_slave_connection = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.backend = sqlalchemy {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.connection = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.connection_debug = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.connection_parameters = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.connection_recycle_time = 3600 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.connection_trace = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.db_inc_retry_interval = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.db_max_retries = 20 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.db_max_retry_interval = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.db_retry_interval = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.max_overflow = 50 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.max_pool_size = 5 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.max_retries = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.mysql_wsrep_sync_wait = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.pool_timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.retry_interval = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.slave_connection = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.sqlite_synchronous = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.synchronous_reader = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] database.use_db_reconnect = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.connection_string = messaging:// {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.es_doc_type = notification {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.es_scroll_size = 10000 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.es_scroll_time = 2m {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.filter_error_trace = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.hmac_keys = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.sentinel_service_name = mymaster {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.socket_timeout = 0.1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.trace_requests = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler.trace_sqlalchemy = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler_jaeger.process_tags = {} {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler_jaeger.service_name_prefix = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] profiler_otlp.service_name_prefix = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.enforce_new_defaults = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: WARNING oslo_config.cfg [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.enforce_scope = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.policy_default_rule = default {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.policy_file = policy.yaml {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.group = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.helper_command = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] privsep_osbrick.user = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.group = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.helper_command = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] cinder_sys_admin.user = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.auth_section = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.auth_type = password {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.cafile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.collect_timing = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.insecure = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.send_service_user_token = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.split_loggers = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] service_user.timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.auth_section = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.auth_type = password {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.collect_timing = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.insecure = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.region_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.split_loggers = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] glance.timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.backend_availability_zone = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.chap_password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.chap_username = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.disk_geometry = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.driver_client_cert = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.driver_client_cert_key = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.driver_data_namespace = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.driver_use_ssl = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.extra_capabilities = {} {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.filter_function = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.goodness_function = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.iscsi_target_flags = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.iscsi_write_cache = on {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.iser_helper = tgtadm {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.iser_port = 3260 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_host = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_login = admin {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_mount_options = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_private_key = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_share_path = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.num_shell_tries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.quobyte_volume_url = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.replication_device = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.report_discard_supported = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.reserved_percentage = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.target_helper = tgtadm {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.target_port = 3260 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.target_protocol = iscsi {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.trace_flags = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.unique_fqdn_network = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.use_chap_auth = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_backend_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_clear = zero {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_clear_ionice = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_clear_size = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_reports.file_event_handler = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_reports.log_dir = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.backend_availability_zone = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.backend_host = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.chap_password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.chap_username = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.chiscsi_conf = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.disk_geometry = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.driver_client_cert = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.driver_data_namespace = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.driver_use_ssl = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.extra_capabilities = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.filter_function = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.goodness_function = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.iser_helper = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.iser_ip_address = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.iser_port = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.iser_target_prefix = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_host = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_login = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_mount_options = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_password = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_private_key = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_share_path = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81665]: INFO cinder.volume.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_ssh_port = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.remotefs [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81665) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.num_shell_tries = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.nvmet_port_id = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.replication_device = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.report_discard_supported = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.reserved_percentage = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.scst_target_driver = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.storage_protocol = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.target_helper = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.target_ip_address = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.target_port = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.target_prefix = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.target_protocol = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.trace_flags = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.use_chap_auth = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_clear = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_clear_size = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] QuobyteHD.volumes_dir = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.ssl = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_notifications.driver = [] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_notifications.retry = -1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] key_manager.fixed_key = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.barbican_api_version = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.barbican_endpoint = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.barbican_endpoint_type = public {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.barbican_region_name = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.cafile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.collect_timing = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.insecure = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.number_of_retries = 60 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.retry_delay = 1 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.send_service_user_token = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.split_loggers = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.verify_ssl = True {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican.verify_ssl_path = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.auth_section = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.auth_type = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.cafile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.certfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.collect_timing = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.insecure = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.keyfile = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.split_loggers = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] barbican_service_user.timeout = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.approle_role_id = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.approle_secret_id = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.kv_mountpoint = secret {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.kv_path = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.kv_version = 2 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.namespace = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.root_token_id = **** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.ssl_ca_crt_file = None {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.timeout = 60.0 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.use_ssl = False {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:21 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] ******************************************************************************** {{(pid=81548) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81665) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:52:21 devstack cinder-volume[81665]: WARNING cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:52:21 devstack cinder-volume[81665]: WARNING cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Running cmd (subprocess): mount.quobyte {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack quobyte-client[81666]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:52:21 devstack quobyte-client[81666]: Invalid parameters found, error: missing mount point. Apr 21 20:52:21 devstack quobyte-client[81666]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:52:21 devstack quobyte-client[81666]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=81665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:21 devstack cinder-volume[81665]: INFO cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 ... Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa -c /etc/quobyte/client-cinder.cfg {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack sudo[81667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa -c /etc/quobyte/client-cinder.cfg Apr 21 20:52:21 devstack sudo[81667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:21 devstack sudo[81667]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.507s {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:21 devstack cinder-volume[81665]: INFO cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 succeeded Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=81665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.515s {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:21 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack sudo[81736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:52:21 devstack sudo[81736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack sudo[81736]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.448s {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[81665]: INFO cinder.volume.driver [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG cinder.volume.driver [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81665) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_db.sqlalchemy.engines [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG dbcounter [-] [81665] Writer thread running {{(pid=81665) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG cinder.db.sqlalchemy.api [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Building query based on filter {{(pid=81665) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG cinder.image.image_utils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81665) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:52:22 devstack cinder-volume[81665]: INFO cinder.keymgr.migration [None req-b9024e12-1f50-4905-85a2-9eb6ff7cdd3a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=81665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=81665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[81739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:52:22 devstack sudo[81739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack sudo[81739]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.535s {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[81665]: DEBUG cinder.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Notifying Schedulers of capabilities ... {{(pid=81665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:23 devstack cinder-volume[81665]: INFO cinder.volume.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Driver initialization completed successfully. Apr 21 20:52:23 devstack cinder-volume[81665]: INFO cinder.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Initiating service 3 cleanup Apr 21 20:52:23 devstack cinder-volume[81665]: INFO cinder.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Service 3 cleanup completed. Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG cinder.service [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Creating RPC server for service cinder-volume {{(pid=81665) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG cinder.service [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81665) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:52:23 devstack cinder-volume[81665]: INFO cinder.volume.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=81665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG cinder.volume.drivers.quobyte [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=81665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81665) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack sudo[81772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:52:23 devstack sudo[81772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack sudo[81772]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:23 devstack cinder-volume[81665]: DEBUG oslo_concurrency.processutils [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.564s {{(pid=81665) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:23 devstack cinder-volume[81665]: INFO cinder.volume.manager [None req-36b0d1ae-e7e4-4687-9cda-43402e498ed5 None None] Driver post RPC initialization completed successfully. Apr 21 20:52:25 devstack cinder-volume[81548]: INFO oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Caught SIGTERM, stopping children Apr 21 20:52:25 devstack cinder-volume[81548]: DEBUG oslo_concurrency.lockutils [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Acquiring lock "singleton_lock" {{(pid=81548) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:52:25 devstack cinder-volume[81548]: DEBUG oslo_concurrency.lockutils [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Acquired lock "singleton_lock" {{(pid=81548) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:52:25 devstack cinder-volume[81548]: DEBUG oslo_concurrency.lockutils [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Releasing lock "singleton_lock" {{(pid=81548) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:52:25 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Stop services. {{(pid=81548) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:52:25 devstack cinder-volume[81548]: DEBUG oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Killing children. {{(pid=81548) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:52:25 devstack cinder-volume[81548]: INFO oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Waiting on 1 children to exit Apr 21 20:52:25 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Acquiring lock "singleton_lock" {{(pid=81665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:52:25 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Acquired lock "singleton_lock" {{(pid=81665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:52:25 devstack cinder-volume[81665]: DEBUG oslo_concurrency.lockutils [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Releasing lock "singleton_lock" {{(pid=81665) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:52:25 devstack cinder-volume[81665]: WARNING amqp [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:52:25 devstack cinder-volume[81665]: WARNING amqp [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:52:25 devstack cinder-volume[81548]: INFO oslo_service.backend._eventlet.service [None req-c76ddc52-d50a-4f3d-9369-a5487b130d0a None None] Child 81665 exited with status 0 Apr 21 20:52:25 devstack cinder-volume[81880]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:52:25 devstack cinder-volume[81880]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:52:25 devstack cinder-volume[81880]: we strongly recommend against using it for new projects. Apr 21 20:52:25 devstack cinder-volume[81880]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:52:25 devstack cinder-volume[81880]: framework. For more detail see Apr 21 20:52:25 devstack cinder-volume[81880]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:52:25 devstack cinder-volume[81880]: import eventlet # noqa Apr 21 20:52:27 devstack cinder-volume[81880]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:52:27 devstack cinder-volume[81880]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:52:27 devstack cinder-volume[81880]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:52:27 devstack cinder-volume[81880]: INFO dbcounter [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Registered counter for database cinder Apr 21 20:52:27 devstack cinder-volume[81880]: DEBUG oslo_db.sqlalchemy.engines [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG dbcounter [-] [81880] Writer thread running {{(pid=81880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:52:28 devstack cinder-volume[81880]: INFO cinder.rpc [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:52:28 devstack cinder-volume[81880]: INFO cinder.rpc [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_db.sqlalchemy.engines [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:28 devstack cinder-volume[81880]: INFO cinder.volume.manager [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Determined volume DB was empty at startup. Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG cinder.volume.manager [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81880) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:52:28 devstack cinder-volume[81880]: WARNING stevedore.named [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:52:28 devstack cinder-volume[81880]: WARNING castellan.key_manager [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:52:28 devstack cinder-volume[81880]: WARNING cinder.keymgr.conf_key_mgr [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:52:28 devstack cinder-volume[81880]: INFO cinder.volume.manager [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_db.sqlalchemy.engines [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:28 devstack cinder-volume[81880]: INFO oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Starting 1 workers Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Started child 82005 {{(pid=81880) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Full set of CONF: {{(pid=81880) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] ******************************************************************************** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Configuration options gathered from: {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] ================================================================================ {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] allow_availability_zone_fallback = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] allow_compression_on_image_upload = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] allowed_direct_url_schemes = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] api_rate_limit = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] auth_strategy = keystone {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_availability_zone = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_host = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_stats_polling_interval = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backup_api_class = cinder.backup.api.API {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backup_name_template = backup-%s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backup_use_same_host = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backup_use_temp_snapshot = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] chap_password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] chap_username = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_internal_tenant_project_id = 72b4fb37cf984d669e257f43b0c9f33b {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_internal_tenant_user_id = d5a42f172c874f78a60bbf769f7c3cce {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cluster = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] compression_format = gzip {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] compute_api_class = cinder.compute.nova.API {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] config_dir = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] config_source = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] control_exchange = openstack {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] debug = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[82005]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] default_availability_zone = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] default_group_type = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] default_volume_type = QuobyteHD {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] disk_geometry = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] driver_client_cert = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] driver_client_cert_key = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] driver_data_namespace = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] driver_ssl_cert_path = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] driver_ssl_cert_verify = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] driver_use_ssl = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] enable_new_services = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] enable_unsupported_driver = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] enabled_backends = ['QuobyteHD'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] enforce_multipath_for_image_xfer = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] filter_function = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_api_insecure = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_api_ssl_compression = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_ca_certificates_file = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_catalog_info = image:glance:publicURL {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_num_retries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance_request_timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] goodness_function = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] graceful_shutdown_timeout = 5 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] group_api_class = cinder.group.api.API {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] host = devstack {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_compress_on_upload = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_conversion_address_space_limit = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_conversion_cpu_limit = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_conversion_disable = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_upload_use_cinder_backend = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_upload_use_internal_tenant = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_volume_cache_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_volume_cache_max_count = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] image_volume_cache_max_size_gb = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] init_host_max_objects_retrieval = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] instance_format = [instance: %(uuid)s] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] iscsi_target_flags = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] iscsi_write_cache = on {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] iser_helper = tgtadm {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] iser_ip_address = 192.168.122.249 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] iser_port = 3260 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_color = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_config_append = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_dir = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_file = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_options = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_rotate_interval = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_rotate_interval_type = days {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] log_rotation_type = none {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] max_age = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] max_logfile_count = 30 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] max_logfile_size_mb = 200 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] max_over_subscription_ratio = 20.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] message_reap_interval = 86400 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] message_ttl = 2592000 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82005) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] migration_create_volume_timeout_secs = 300 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] monkey_patch = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] monkey_patch_modules = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] my_ip = 192.168.122.249 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] no_snapshot_gb_quota = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] num_iser_scan_tries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] num_shell_tries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] num_volume_device_scan_tries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] nvmeof_conn_info_version = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] nvmet_ns_id = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] nvmet_port_id = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_max_limit = 1000 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_volume_ext_list = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_volume_listen_port = 8776 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_volume_use_ssl = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] osapi_volume_workers = 2 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] per_volume_size_limit = -1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] periodic_fuzzy_delay = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] periodic_interval = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] public_endpoint = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] publish_errors = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_backup_gigabytes = 1000 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_backups = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_gigabytes = 1000 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_groups = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_snapshots = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] quota_volumes = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] rate_limit_burst = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] rate_limit_except_level = CRITICAL {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] rate_limit_interval = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] reinit_driver_count = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] replication_device = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] report_discard_supported = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] report_interval = 120 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] reservation_clean_interval = 86400 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] reservation_expire = 86400 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] reserved_image_namespaces = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] reserved_percentage = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] rpc_response_timeout = 120 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] run_external_periodic_tasks = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] scst_target_driver = iscsi {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] scst_target_iqn_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_down_time = 720 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] shell_completion = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] snapshot_name_template = snapshot-%s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] split_loggers = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] state_path = /opt/stack/data/cinder {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] storage_availability_zone = nova {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] storage_protocol = iSCSI {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] syslog_log_facility = LOG_USER {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] target_helper = lioadm {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] target_ip_address = 192.168.122.249 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] target_port = 3260 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] target_protocol = iscsi {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] target_secondary_ip_addresses = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] trace_flags = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] transport_url = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] until_refresh = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_chap_auth = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_default_quota_class = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_journal = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_json = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_multipath_for_image_xfer = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_stderr = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] use_syslog = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] verify_glance_signatures = enabled {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_api_class = cinder.volume.api.API {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_backend_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_clear = zero {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_clear_ionice = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_clear_size = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_copy_bps_limit = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_dd_blocksize = 1M {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_name_template = volume-%s {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_service_inithost_offload = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volume_usage_audit_period = month {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] zoning_mode = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_concurrency.disable_process_locking = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.admin_password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.admin_token = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.admin_user = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_port = 35357 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_protocol = https {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_section = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_type = password {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_uri = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.auth_version = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.cache = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.identity_uri = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.include_service_catalog = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82005) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.insecure = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.interface = public {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_password = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:52:28 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Running cmd (subprocess): mount.quobyte {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcache_username = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.region_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.service_type = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.backend = dogpile.cache.null {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.backend_argument = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.backend_expiration_time = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.config_prefix = cache.oslo {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.debug_cache_backend = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.enable_retry_client = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.enable_socket_keepalive = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.enforce_fips_mode = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.expiration_time = 600 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.hashclient_retry_attempts = 2 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_dead_retry = 300 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_pool_maxsize = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_sasl_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.proxies = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.redis_db = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.redis_server = localhost:6379 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.retry_attempts = 2 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.retry_delay = 0.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.socket_keepalive_count = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.socket_keepalive_idle = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.socket_keepalive_interval = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.socket_timeout = 1.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.tls_allowed_ciphers = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.tls_cafile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.tls_certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.tls_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.tls_keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cache.username = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] coordination.backend_url = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.asyncio_connection = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.asyncio_slave_connection = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.backend = sqlalchemy {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.connection = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.connection_debug = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.connection_parameters = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.connection_recycle_time = 3600 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.connection_trace = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.db_inc_retry_interval = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.db_max_retries = 20 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.db_max_retry_interval = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.db_retry_interval = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.max_overflow = 50 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.max_pool_size = 5 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.max_retries = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.mysql_wsrep_sync_wait = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.pool_timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.retry_interval = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.slave_connection = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.sqlite_synchronous = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.synchronous_reader = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] database.use_db_reconnect = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.connection_string = messaging:// {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.es_doc_type = notification {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.es_scroll_size = 10000 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.es_scroll_time = 2m {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.filter_error_trace = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.hmac_keys = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.sentinel_service_name = mymaster {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.socket_timeout = 0.1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.trace_requests = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler.trace_sqlalchemy = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler_jaeger.process_tags = {} {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler_jaeger.service_name_prefix = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] profiler_otlp.service_name_prefix = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.enforce_new_defaults = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: WARNING oslo_config.cfg [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.enforce_scope = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.policy_default_rule = default {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.policy_file = policy.yaml {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.group = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.helper_command = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] privsep_osbrick.user = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.group = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.helper_command = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] cinder_sys_admin.user = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.auth_section = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.auth_type = password {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.cafile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.collect_timing = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.insecure = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.send_service_user_token = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.split_loggers = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] service_user.timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.auth_section = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.auth_type = password {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.collect_timing = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.insecure = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.region_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.split_loggers = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack quobyte-client[82019]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:52:28 devstack quobyte-client[82019]: Invalid parameters found, error: missing mount point. Apr 21 20:52:28 devstack quobyte-client[82019]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:52:28 devstack quobyte-client[82019]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] glance.timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.backend_availability_zone = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.chap_password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.chap_username = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.disk_geometry = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.driver_client_cert = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.driver_client_cert_key = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.driver_data_namespace = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.driver_use_ssl = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.extra_capabilities = {} {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.filter_function = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.goodness_function = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.iscsi_target_flags = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.iscsi_write_cache = on {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.iser_helper = tgtadm {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.iser_port = 3260 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_host = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_login = admin {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_mount_options = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_private_key = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_share_path = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.num_shell_tries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.quobyte_volume_url = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.replication_device = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.report_discard_supported = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.reserved_percentage = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.target_helper = tgtadm {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.target_port = 3260 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.target_protocol = iscsi {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.trace_flags = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.unique_fqdn_network = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.use_chap_auth = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_backend_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_clear = zero {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_clear_ionice = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_clear_size = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_reports.file_event_handler = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_reports.log_dir = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.backend_availability_zone = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.backend_host = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.chap_password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.chap_username = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.chiscsi_conf = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.disk_geometry = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.driver_client_cert = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.driver_data_namespace = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.driver_use_ssl = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.extra_capabilities = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.filter_function = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.goodness_function = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.iser_helper = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.iser_ip_address = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.iser_port = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.iser_target_prefix = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_host = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_login = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_mount_options = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_password = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_private_key = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_share_path = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_ssh_port = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.num_shell_tries = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.nvmet_port_id = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.replication_device = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.report_discard_supported = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.reserved_percentage = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.scst_target_driver = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.storage_protocol = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.target_helper = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.target_ip_address = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.target_port = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.target_prefix = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.target_protocol = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.trace_flags = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.use_chap_auth = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_clear = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_clear_size = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] QuobyteHD.volumes_dir = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack sudo[82021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack sudo[82021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.ssl = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_notifications.driver = [] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_notifications.retry = -1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] key_manager.fixed_key = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.barbican_api_version = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.barbican_endpoint = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.barbican_endpoint_type = public {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.barbican_region_name = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.cafile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.collect_timing = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.insecure = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.number_of_retries = 60 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.retry_delay = 1 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.send_service_user_token = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.split_loggers = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.verify_ssl = True {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican.verify_ssl_path = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.auth_section = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.auth_type = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.cafile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.certfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.collect_timing = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.insecure = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.keyfile = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.split_loggers = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] barbican_service_user.timeout = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.approle_role_id = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.approle_secret_id = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.kv_mountpoint = secret {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.kv_path = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.kv_version = 2 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.namespace = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.root_token_id = **** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.ssl_ca_crt_file = None {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.timeout = 60.0 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.use_ssl = False {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:52:28 devstack cinder-volume[81880]: DEBUG oslo_service.backend._eventlet.service [None req-214e83eb-7c1b-40ce-b860-f6297009f770 None None] ******************************************************************************** {{(pid=81880) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:52:29 devstack sudo[82021]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.676s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:29 devstack cinder-volume[82005]: INFO cinder.volume.driver [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.volume.driver [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82005) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_db.sqlalchemy.engines [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writer thread running {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.db.sqlalchemy.api [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Building query based on filter {{(pid=82005) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82005) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:29 devstack cinder-volume[82005]: INFO cinder.keymgr.migration [None req-0fd84ef8-0f5d-45d8-9537-599062c09032 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:52:29 devstack sudo[82068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:52:29 devstack sudo[82068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:29 devstack sudo[82068]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.436s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Driver initialization completed successfully. Apr 21 20:52:29 devstack cinder-volume[82005]: INFO cinder.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Initiating service 3 cleanup Apr 21 20:52:29 devstack cinder-volume[82005]: INFO cinder.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Service 3 cleanup completed. Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.service [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Creating RPC server for service cinder-volume {{(pid=82005) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.service [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82005) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:52:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:29 devstack sudo[82072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:52:29 devstack sudo[82072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:30 devstack sudo[82072]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.421s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:30 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-410037a2-9cfd-46d9-bef4-11f2cdf20130 None None] Driver post RPC initialization completed successfully. Apr 21 20:52:38 devstack cinder-volume[81880]: DEBUG dbcounter [-] [81880] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:39 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:40 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=3 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:29 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Flow 'volume_create_manager' (15653fcf-1d01-4fb4-85ec-a4eb3c7811a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d204cb2c-8c68-4af4-8e92-f15fb0beaad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d204cb2c-8c68-4af4-8e92-f15fb0beaad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-795967168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8152959-1a66-429c-a9d7-2da1895fac04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0431a2b75524b709f615c471388c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:30Z,use_quota=True,user_id='9427906382d6467fbee3a725103ee331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fee365-d217-4e82-99be-27548799def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fee365-d217-4e82-99be-27548799def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81200c30-d492-49c6-b73f-444aac97693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81200c30-d492-49c6-b73f-444aac97693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8152959-1a66-429c-a9d7-2da1895fac04', 'volume_name': 'volume-a8152959-1a66-429c-a9d7-2da1895fac04', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9d42fc-da45-42cc-ae76-860bbc38167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9d42fc-da45-42cc-ae76-860bbc38167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9500a4f4-58ef-418c-8d7a-908978c672fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Volume a8152959-1a66-429c-a9d7-2da1895fac04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8152959-1a66-429c-a9d7-2da1895fac04', 'volume_size': 1} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-795967168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8152959-1a66-429c-a9d7-2da1895fac04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0431a2b75524b709f615c471388c568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:30Z,use_quota=True,user_id='9427906382d6467fbee3a725103ee331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Creating volume a8152959-1a66-429c-a9d7-2da1895fac04 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:30 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:30 devstack sudo[82599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 1073741824 Apr 21 20:53:30 devstack sudo[82599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Flow 'volume_create_manager' (b39c5542-6263-443f-a2e0-ab689085baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49450794-6ecf-4044-a343-cd11b8f42ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49450794-6ecf-4044-a343-cd11b8f42ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-443842664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dae7cff-43a0-4acd-8c0b-a019c361b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff6f490618244b7ab7dbc552f520319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:30Z,use_quota=True,user_id='7ebd058c34c2424bab067e5a1cf04dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be18a7-f42b-4ca4-90ab-89504203be50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be18a7-f42b-4ca4-90ab-89504203be50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2112271-3ad2-4943-8a48-cc25b1534b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2112271-3ad2-4943-8a48-cc25b1534b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dae7cff-43a0-4acd-8c0b-a019c361b08c', 'volume_name': 'volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67083b8-3f88-4871-9e29-8e7c34d04b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67083b8-3f88-4871-9e29-8e7c34d04b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cd65e5-911e-465c-9b66-21366ca476b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:30 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Volume 3dae7cff-43a0-4acd-8c0b-a019c361b08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c', 'volume_size': 1} Apr 21 20:53:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:32 devstack sudo[82599]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 1073741824" returned: 0 in 2.049s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[82927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 Apr 21 20:53:32 devstack sudo[82927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:34 devstack sudo[82927]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04" returned: 0 in 1.851s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] <== create_volume: return (3987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.990s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.543s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-443842664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dae7cff-43a0-4acd-8c0b-a019c361b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff6f490618244b7ab7dbc552f520319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:30Z,use_quota=True,user_id='7ebd058c34c2424bab067e5a1cf04dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Creating volume 3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:34 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:34 devstack sudo[82940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c 1073741824 Apr 21 20:53:34 devstack sudo[82940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9500a4f4-58ef-418c-8d7a-908978c672fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8152959-1a66-429c-a9d7-2da1895fac04', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce8a84-2d90-444e-a176-0a5d7e6e4716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Flow 'volume_create_manager' (caa489ff-bc61-4874-ab25-13592bc2d6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7974e546-a8f8-4381-a98f-5ad9e49f4eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Volume volume-a8152959-1a66-429c-a9d7-2da1895fac04 (a8152959-1a66-429c-a9d7-2da1895fac04): created successfully Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce8a84-2d90-444e-a176-0a5d7e6e4716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Flow 'volume_create_manager' (15653fcf-1d01-4fb4-85ec-a4eb3c7811a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7974e546-a8f8-4381-a98f-5ad9e49f4eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:34Z,deleted=False,deleted_at=None,display_description='',display_name='9e596478-8e53-4e01-8812-dc31a1fc19a3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9897b6e8-b869-441b-b1bf-c307c5d275ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b867972db48c479aa68d28514c0bd627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:34Z,use_quota=True,user_id='6b26708980654edc8b012349f7ef685a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c1f2ee-21bf-42f7-b647-c10952905303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c1f2ee-21bf-42f7-b647-c10952905303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8acb3d-56c8-4529-9795-012bceb0e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8acb3d-56c8-4529-9795-012bceb0e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9897b6e8-b869-441b-b1bf-c307c5d275ec', 'volume_name': 'volume-9897b6e8-b869-441b-b1bf-c307c5d275ec', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12554ef-9833-40cf-96d4-b563fb6514b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12554ef-9833-40cf-96d4-b563fb6514b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16f1a88-b80c-4c20-ab65-7706476c5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Volume 9897b6e8-b869-441b-b1bf-c307c5d275ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9897b6e8-b869-441b-b1bf-c307c5d275ec', 'volume_size': 1} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b08905cc-85fd-4811-8026-80edfea2135a tempest-VolumesAdminNegativeTest-1457256365 None] Created volume successfully. Apr 21 20:53:34 devstack sudo[82940]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c 1073741824" returned: 0 in 0.749s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:34 devstack sudo[82946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c Apr 21 20:53:34 devstack sudo[82946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:35 devstack sudo[82946]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c" returned: 0 in 0.628s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:34Z,deleted=False,deleted_at=None,display_description='',display_name='9e596478-8e53-4e01-8812-dc31a1fc19a3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9897b6e8-b869-441b-b1bf-c307c5d275ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b867972db48c479aa68d28514c0bd627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:34Z,use_quota=True,user_id='6b26708980654edc8b012349f7ef685a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Creating volume 9897b6e8-b869-441b-b1bf-c307c5d275ec {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:35 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cd65e5-911e-465c-9b66-21366ca476b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b7eb64-ba46-4a90-a436-4ee661f270d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:35 devstack sudo[82950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec 1073741824 Apr 21 20:53:35 devstack sudo[82950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:35 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Volume volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c (3dae7cff-43a0-4acd-8c0b-a019c361b08c): created successfully Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b7eb64-ba46-4a90-a436-4ee661f270d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Flow 'volume_create_manager' (b39c5542-6263-443f-a2e0-ab689085baa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:35 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-06e9f7e1-df76-44b6-a928-9d5d8e42f895 req-c588e68d-9a50-4a40-bd82-ef6bf7a6ae29 tempest-VolumesSnapshotsTestJSON-1300278141 None] Created volume successfully. Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[82959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:53:36 devstack sudo[82959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Acquiring lock "cinder-a8152959-1a66-429c-a9d7-2da1895fac04-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Lock "cinder-a8152959-1a66-429c-a9d7-2da1895fac04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Acquiring lock "cinder-quobyte-a8152959-1a66-429c-a9d7-2da1895fac04" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Lock "cinder-quobyte-a8152959-1a66-429c-a9d7-2da1895fac04" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[82005]: INFO oslo.privsep.daemon [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp12r7i7f4/privsep.sock'] Apr 21 20:53:36 devstack sudo[82961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp12r7i7f4/privsep.sock Apr 21 20:53:36 devstack sudo[82961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:36 devstack sudo[82950]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec 1073741824" returned: 0 in 1.301s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[82963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec Apr 21 20:53:36 devstack sudo[82963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:53:37 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 21 20:53:38 devstack sudo[82959]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 1.972s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:38 devstack sudo[82963]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec" returned: 0 in 1.556s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] <== create_volume: return (2895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.899s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.354s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16f1a88-b80c-4c20-ab65-7706476c5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9897b6e8-b869-441b-b1bf-c307c5d275ec', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6017c59-8eba-4fb5-977d-710a4ffd81eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Creating offline snapshot 64d2f69e-dfa9-4513-8ca6-4ea4472e9116 of volume 3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:38 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Volume volume-9897b6e8-b869-441b-b1bf-c307c5d275ec (9897b6e8-b869-441b-b1bf-c307c5d275ec): created successfully Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6017c59-8eba-4fb5-977d-710a4ffd81eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Flow 'volume_create_manager' (caa489ff-bc61-4874-ab25-13592bc2d6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-646ab6aa-c19d-401a-b180-57669a63d207 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Created volume successfully. Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:53:38 devstack cinder-volume[82005]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 21 20:53:39 devstack sudo[82961]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:39 devstack cinder-volume[82005]: INFO oslo.privsep.daemon [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Spawned new privsep daemon via rootwrap Apr 21 20:53:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Accepted privsep connection to /tmp/tmp12r7i7f4/privsep.sock {{(pid=82005) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 21 20:53:39 devstack cinder-volume[82005]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 21 20:53:39 devstack cinder-volume[82005]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 21 20:53:39 devstack cinder-volume[82005]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 21 20:53:39 devstack cinder-volume[82005]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82992 Apr 21 20:53:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bfb6a6-0a99-4611-b742-28b325778280]: (2,) {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:39 devstack cinder-volume[82005]: WARNING oslo_privsep.priv_context [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] privsep daemon already running Apr 21 20:53:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4a1910-d189-401a-97ea-b0ff520d9334]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d164f3-b124-4dd3-a170-cb2685a20d73]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack sudo[82998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c Apr 21 20:53:39 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:39 devstack sudo[82997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 Apr 21 20:53:39 devstack sudo[82997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:40 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c" returned: 0 in 0.795s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:40 devstack sudo[83037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 1G Apr 21 20:53:40 devstack sudo[83037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:40 devstack sudo[82997]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04" returned: 0 in 0.829s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:40 devstack sudo[83039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04 Apr 21 20:53:40 devstack sudo[83039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:40 devstack sudo[83039]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a8152959-1a66-429c-a9d7-2da1895fac04" returned: 0 in 0.556s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Lock "cinder-quobyte-a8152959-1a66-429c-a9d7-2da1895fac04" released by "delete_volume" :: held 4.215s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:40 devstack cinder-volume[82005]: WARNING cinder.quota [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:40 devstack cinder-volume[82005]: WARNING cinder.quota [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:40 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Created reservations ['033ccbee-e9ee-485c-8efd-9d7df6264d7b', 'c0f7f462-05db-4df8-a27c-78453fd40831', '5c00e619-e439-4352-9b91-b973fd91dbc7', '290edf07-7020-44b3-84ef-6aba849c017b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:40 devstack sudo[83037]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 1G" returned: 0 in 1.006s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:41 devstack sudo[83045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 Apr 21 20:53:41 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:41 devstack sudo[83047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:53:41 devstack sudo[83047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116" returned: 0 in 1.148s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 is being set with open permissions: ugo+rw Apr 21 20:53:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:42 devstack sudo[83060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 Apr 21 20:53:42 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[83047]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 1.264s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:42 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Deleted volume successfully. Apr 21 20:53:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-603a15ff-55ad-43c3-b974-feeb634a2b29 tempest-VolumesAdminNegativeTest-1457256365 None] Lock "cinder-a8152959-1a66-429c-a9d7-2da1895fac04-delete_volume" released by "delete_volume" :: held 6.145s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:43 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116" returned: 0 in 1.190s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:43 devstack sudo[83090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info Apr 21 20:53:43 devstack sudo[83090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:44 devstack cinder-volume[82005]: WARNING py.warnings [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 21 20:53:44 devstack cinder-volume[82005]: .first() Apr 21 20:53:44 devstack cinder-volume[82005]: Apr 21 20:53:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:44 devstack sudo[83090]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info" returned: 0 in 1.362s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:44 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info is being set with open permissions: ugo+rw Apr 21 20:53:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:44 devstack sudo[83126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info Apr 21 20:53:44 devstack sudo[83126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack sudo[83126]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.info" returned: 0 in 0.528s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.956s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.814s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21eb086-186a-4503-ade2-df851bf78db7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-1592c901-458b-441a-923e-743130c5c517 req-f39480b4-6b77-4659-bd59-735c62daeeef tempest-VolumesSnapshotsTestJSON-1300278141 None] Create snapshot completed successfully Apr 21 20:53:45 devstack sudo[83129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec Apr 21 20:53:45 devstack sudo[83129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "cinder-64d2f69e-dfa9-4513-8ca6-4ea4472e9116-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-64d2f69e-dfa9-4513-8ca6-4ea4472e9116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "cinder-quobyte-3dae7cff-43a0-4acd-8c0b-a019c361b08c" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-quobyte-3dae7cff-43a0-4acd-8c0b-a019c361b08c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "cinder-quobyte-64d2f69e-dfa9-4513-8ca6-4ea4472e9116" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-quobyte-64d2f69e-dfa9-4513-8ca6-4ea4472e9116" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Deleting offline snapshot 64d2f69e-dfa9-4513-8ca6-4ea4472e9116 of volume 3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] snapshot_file for this snap is: volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80f2b71-680a-463a-ac54-d00e3ff5caf1]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[83129]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec" returned: 0 in 0.789s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:46 devstack sudo[83137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 Apr 21 20:53:46 devstack sudo[83137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207', 'name': 'volume-9897b6e8-b869-441b-b1bf-c307c5d275ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '167638ad-d21e-4f95-8137-d11c58a508c3', 'enforce_multipath': True} {{(pid=82005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:53:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-14135d3b-5c85-48ed-82d9-9e690e0b618e req-3a33efa7-2b07-4e1e-a769-ee24637ed529 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] attachment_update completed successfully. Apr 21 20:53:46 devstack sudo[83137]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116" returned: 0 in 0.669s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[369b6acf-7e5f-41ea-86a2-16f423e99f80]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[83157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c Apr 21 20:53:46 devstack sudo[83157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:47 devstack sudo[83157]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c" returned: 0 in 0.594s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:47 devstack sudo[83163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 Apr 21 20:53:47 devstack sudo[83163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:47 devstack sudo[83163]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116" returned: 0 in 0.529s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:47 devstack sudo[83168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116 Apr 21 20:53:47 devstack sudo[83168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack sudo[83168]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c.64d2f69e-dfa9-4513-8ca6-4ea4472e9116" returned: 0 in 0.455s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-quobyte-64d2f69e-dfa9-4513-8ca6-4ea4472e9116" released by "_delete_snapshot" :: held 2.330s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-quobyte-3dae7cff-43a0-4acd-8c0b-a019c361b08c" released by "delete_snapshot" :: held 2.351s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:48 devstack cinder-volume[82005]: WARNING cinder.quota [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:48 devstack cinder-volume[82005]: DEBUG cinder.quota [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Created reservations ['8538743f-1dfa-48e8-b572-7376f207db70', 'f4c0e572-a7f5-44e7-bd8a-7bc66cc226d3', 'ae26f4ab-2379-4916-a73c-0bc743382320', 'e8d5ae40-270d-4c46-ae73-01c17247e72f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Delete snapshot completed successfully. Apr 21 20:53:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-f5da3b8c-2aa6-4df4-9528-8e13dd4f874a req-31f55a64-09bf-4e9f-9d01-a1c6b1a83d04 tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-64d2f69e-dfa9-4513-8ca6-4ea4472e9116-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "cinder-3dae7cff-43a0-4acd-8c0b-a019c361b08c-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-3dae7cff-43a0-4acd-8c0b-a019c361b08c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "cinder-quobyte-3dae7cff-43a0-4acd-8c0b-a019c361b08c" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-quobyte-3dae7cff-43a0-4acd-8c0b-a019c361b08c" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:49 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bf5337-7d77-4390-bd67-9417994b3630]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[83249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c Apr 21 20:53:49 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c" returned: 0 in 0.634s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c Apr 21 20:53:50 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3dae7cff-43a0-4acd-8c0b-a019c361b08c" returned: 0 in 0.751s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-quobyte-3dae7cff-43a0-4acd-8c0b-a019c361b08c" released by "delete_volume" :: held 1.432s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:50 devstack cinder-volume[82005]: DEBUG cinder.quota [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Created reservations ['e845a0a2-dd16-4939-9437-2df6d29d5c84', '5758abc3-863a-4fb3-9cb8-2238f1c1d08a', 'f7e5f48e-81a7-4107-9260-e219320dfa0c', '58e154b0-1e87-4f3e-ba1c-660139d30982'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[83336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:53:51 devstack sudo[83336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack sudo[83336]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 1.475s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[82005]: DEBUG cinder.manager [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:52 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Deleted volume successfully. Apr 21 20:53:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-b19599c2-7802-4466-8ef5-2bb8f2ef2405 req-98738ac0-4f65-4c72-a615-c8a09aec2ccb tempest-VolumesSnapshotsTestJSON-1300278141 None] Lock "cinder-3dae7cff-43a0-4acd-8c0b-a019c361b08c-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=32,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:02 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=32,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=5 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Flow 'volume_create_manager' (d470809b-bfd5-4369-b7ce-862f90fd814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9271b034-59e9-4fd8-bc46-31da17c8bfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9271b034-59e9-4fd8-bc46-31da17c8bfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2008855968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb192fb0-3029-4f23-9003-98d765ffee13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276b0c8855884019a787459a1e7df138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:06Z,use_quota=True,user_id='b8c0ed231771440096b12d803bc9dfca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb84435-3f0c-4c65-8204-9e4d0c2b34e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb84435-3f0c-4c65-8204-9e4d0c2b34e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9306cb0-9fa0-41c8-a734-ea67d925944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9306cb0-9fa0-41c8-a734-ea67d925944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb192fb0-3029-4f23-9003-98d765ffee13', 'volume_name': 'volume-eb192fb0-3029-4f23-9003-98d765ffee13', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2ae974-84a7-4c18-957a-42241bf27e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2ae974-84a7-4c18-957a-42241bf27e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ff32d9-fdda-4618-901a-57fe8a3d3114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Volume eb192fb0-3029-4f23-9003-98d765ffee13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb192fb0-3029-4f23-9003-98d765ffee13', 'volume_size': 1} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2008855968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb192fb0-3029-4f23-9003-98d765ffee13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276b0c8855884019a787459a1e7df138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:06Z,use_quota=True,user_id='b8c0ed231771440096b12d803bc9dfca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Creating volume eb192fb0-3029-4f23-9003-98d765ffee13 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:06 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:06 devstack sudo[83811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 1073741824 Apr 21 20:54:06 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Flow 'volume_create_manager' (a651e3d9-0731-4cfc-9217-29095611b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9afe663-aae9-4685-b506-d186b9951fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9afe663-aae9-4685-b506-d186b9951fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1304329559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af0d5a6-280c-45f8-a9b6-23e435ba1e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14aff14e39d4cac9dae43c779e9a121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:07Z,use_quota=True,user_id='e8340c31d2cb463e93365e179f468090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6403ac-f27f-4eda-bc55-5ab74acafe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6403ac-f27f-4eda-bc55-5ab74acafe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f59c657-b33b-49af-a455-68ff7e346d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f59c657-b33b-49af-a455-68ff7e346d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af0d5a6-280c-45f8-a9b6-23e435ba1e87', 'volume_name': 'volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7473da20-8cfb-4277-bf4d-7c8ef852feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7473da20-8cfb-4277-bf4d-7c8ef852feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14ab7b1-0576-4594-9d67-4dfb729d7877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:06 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87', 'volume_size': 1} Apr 21 20:54:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:07 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 1073741824" returned: 0 in 0.893s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:07 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 Apr 21 20:54:07 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:07 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13" returned: 0 in 0.530s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1304329559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af0d5a6-280c-45f8-a9b6-23e435ba1e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14aff14e39d4cac9dae43c779e9a121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:07Z,use_quota=True,user_id='e8340c31d2cb463e93365e179f468090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Creating volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:07 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ff32d9-fdda-4618-901a-57fe8a3d3114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb192fb0-3029-4f23-9003-98d765ffee13', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1b7299-dd89-4656-ba0b-9d24edfc1950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:07 devstack sudo[83820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 1073741824 Apr 21 20:54:07 devstack sudo[83820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:07 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Volume volume-eb192fb0-3029-4f23-9003-98d765ffee13 (eb192fb0-3029-4f23-9003-98d765ffee13): created successfully Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1b7299-dd89-4656-ba0b-9d24edfc1950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Flow 'volume_create_manager' (d470809b-bfd5-4369-b7ce-862f90fd814b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e5344b88-d48d-400b-8f35-1ee2d82852d9 tempest-ServerRescueNegativeTestJSON-1835551306 None] Created volume successfully. Apr 21 20:54:08 devstack sudo[83820]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 1073741824" returned: 0 in 1.018s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:08 devstack sudo[83877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 Apr 21 20:54:08 devstack sudo[83877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:10 devstack sudo[83877]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" returned: 0 in 1.160s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14ab7b1-0576-4594-9d67-4dfb729d7877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f7cf9e-0a61-4acc-a7dc-ff6a4b13e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:10 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Volume volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 (1af0d5a6-280c-45f8-a9b6-23e435ba1e87): created successfully Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f7cf9e-0a61-4acc-a7dc-ff6a4b13e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Flow 'volume_create_manager' (a651e3d9-0731-4cfc-9217-29095611b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-dc589bbe-5169-41e0-bcfa-8de860b5986c tempest-SnapshotsActionsTest-1190534978 None] Created volume successfully. Apr 21 20:54:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Creating offline snapshot 40780a8a-eed9-4d1c-9a0d-5698574c2b10 of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01be503-b606-468f-855d-703cf4267b1b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:11 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 Apr 21 20:54:11 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:12 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" returned: 0 in 1.086s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:12 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 1G Apr 21 20:54:12 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:13 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 1G" returned: 0 in 0.847s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[83919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:13 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.787s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 is being set with open permissions: ugo+rw Apr 21 20:54:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:14 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:14 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.770s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[83999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info Apr 21 20:54:15 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info" returned: 0 in 0.718s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info is being set with open permissions: ugo+rw Apr 21 20:54:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info Apr 21 20:54:15 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.info" returned: 0 in 0.507s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:16 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-179c1535-1294-4f67-bf07-9ee8649b57c5 tempest-SnapshotsActionsTest-1190534978 None] Create snapshot completed successfully Apr 21 20:54:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Creating offline snapshot 4c736d70-be7d-42cc-82e5-dd9cade8ad96 of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:17 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee667c-c64b-4c0c-b631-3658e0ddacaf]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[84023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:17 devstack sudo[84023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[84023]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 1.090s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack sudo[84055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 1G Apr 21 20:54:18 devstack sudo[84055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack sudo[84055]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 1G" returned: 0 in 0.930s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[84066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 Apr 21 20:54:19 devstack sudo[84066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[84066]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96" returned: 0 in 0.824s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 is being set with open permissions: ugo+rw Apr 21 20:54:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 Apr 21 20:54:20 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.489s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:20 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2d783b3b-ac77-459c-b1b4-6205e2d0ff7a tempest-SnapshotsActionsTest-1190534978 None] Create snapshot completed successfully Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-4c736d70-be7d-42cc-82e5-dd9cade8ad96-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-4c736d70-be7d-42cc-82e5-dd9cade8ad96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-4c736d70-be7d-42cc-82e5-dd9cade8ad96" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-4c736d70-be7d-42cc-82e5-dd9cade8ad96" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Deleting offline snapshot 4c736d70-be7d-42cc-82e5-dd9cade8ad96 of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] snapshot_file for this snap is: volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc77966-31db-4857-b1b1-50396a6d1eae]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:21 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 Apr 21 20:54:21 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:22 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96" returned: 0 in 0.702s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:22 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5687b08-3abc-4783-9878-01292c209d5d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:22 devstack sudo[84118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:22 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.761s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 Apr 21 20:54:23 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96" returned: 0 in 0.718s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96 Apr 21 20:54:24 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Acquiring lock "cinder-eb192fb0-3029-4f23-9003-98d765ffee13-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "cinder-eb192fb0-3029-4f23-9003-98d765ffee13-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Acquiring lock "cinder-quobyte-eb192fb0-3029-4f23-9003-98d765ffee13" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "cinder-quobyte-eb192fb0-3029-4f23-9003-98d765ffee13" acquired by "delete_volume" :: waited 0.033s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d49b93-3a60-4216-8c0d-5387e854ba92]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[84157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 Apr 21 20:54:24 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.4c736d70-be7d-42cc-82e5-dd9cade8ad96" returned: 0 in 0.934s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-4c736d70-be7d-42cc-82e5-dd9cade8ad96" released by "_delete_snapshot" :: held 3.284s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" released by "delete_snapshot" :: held 3.325s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Created reservations ['9c6ec7ab-e491-4e2b-a5d1-bc34fbab3b5b', '2317f359-c827-412a-9b5f-7a2c1f27481b', 'eda87b2a-8c35-4d29-b587-5ea33d8ffaa0', 'df2b705a-f100-424e-ac79-8df6f5f25bce'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Delete snapshot completed successfully. Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-71fd3285-0432-4d50-aec0-aa159c74a634 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-4c736d70-be7d-42cc-82e5-dd9cade8ad96-delete_snapshot" released by "delete_snapshot" :: held 3.650s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13" returned: 0 in 1.053s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:25 devstack sudo[84167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13 Apr 21 20:54:25 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eb192fb0-3029-4f23-9003-98d765ffee13" returned: 0 in 0.773s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "cinder-quobyte-eb192fb0-3029-4f23-9003-98d765ffee13" released by "delete_volume" :: held 1.913s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Creating offline snapshot e0b85446-7be0-482f-91ae-79c390f4c906 of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0107927-2318-4319-ac2d-bfdf21790270]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Created reservations ['2223f7bd-f0ef-46cb-8ce3-64b84f2c4498', '7db6540d-b00e-4bdf-bc64-65819e59f17d', 'f52e7325-28e0-4ed1-94a9-39395f5d9853', '7ecd80f5-c968-4db8-bf2c-b9b1483689a2'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:26 devstack sudo[84187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:26 devstack sudo[84187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:54:26 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:27 devstack sudo[84187]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.776s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:27 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 1G Apr 21 20:54:27 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:27 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.805s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Deleted volume successfully. Apr 21 20:54:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7b18ada-0aab-4b08-9f88-bb223c609457 tempest-ServerRescueNegativeTestJSON-1835551306 None] Lock "cinder-eb192fb0-3029-4f23-9003-98d765ffee13-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:28 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 1G" returned: 0 in 0.938s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:28 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 Apr 21 20:54:28 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:29 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906" returned: 0 in 0.781s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 is being set with open permissions: ugo+rw Apr 21 20:54:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:29 devstack sudo[84249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 Apr 21 20:54:29 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:29 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906" returned: 0 in 0.476s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.073s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b1c48f28-0c3c-4a35-8ac5-a62a5138dad7 tempest-SnapshotsActionsTest-1190534978 None] Create snapshot completed successfully Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-e0b85446-7be0-482f-91ae-79c390f4c906-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-e0b85446-7be0-482f-91ae-79c390f4c906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-e0b85446-7be0-482f-91ae-79c390f4c906" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-e0b85446-7be0-482f-91ae-79c390f4c906" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Deleting offline snapshot e0b85446-7be0-482f-91ae-79c390f4c906 of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] snapshot_file for this snap is: volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7628d6-0af9-40bc-8958-0e09c26a1736]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:30 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 Apr 21 20:54:30 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:31 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906" returned: 0 in 0.558s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:31 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3152a76-95bc-4ada-bf3c-dbc3168d60a6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:31 devstack sudo[84300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:31 devstack sudo[84300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:32 devstack sudo[84300]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.687s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:32 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 Apr 21 20:54:32 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:32 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906" returned: 0 in 0.612s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:32 devstack sudo[84339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906 Apr 21 20:54:32 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:33 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.e0b85446-7be0-482f-91ae-79c390f4c906" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-e0b85446-7be0-482f-91ae-79c390f4c906" released by "_delete_snapshot" :: held 2.353s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" released by "delete_snapshot" :: held 2.372s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Created reservations ['7a47501d-d66d-45e3-b1f4-528104537cc5', 'b6b599e8-2b21-4dc3-b475-9bee450ec94d', '9e200237-510e-4273-b7ed-32d0e34faadb', '0249b1c4-ebdb-4f9a-a39c-525be320d0ad'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:33 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Delete snapshot completed successfully. Apr 21 20:54:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-77e855c1-c4f9-4480-af25-009442a68f13 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-e0b85446-7be0-482f-91ae-79c390f4c906-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Creating offline snapshot 613e2cc5-5d82-44fd-909c-c02f098e145b of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cfb86b-d408-4ab4-aee8-2dbe094548fd]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:34 devstack sudo[84373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:34 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:35 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.837s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:35 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b 1G Apr 21 20:54:35 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b 1G" returned: 0 in 0.678s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b Apr 21 20:54:36 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[84407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:54:36 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b" returned: 0 in 0.721s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b is being set with open permissions: ugo+rw Apr 21 20:54:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b Apr 21 20:54:36 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.762s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:37 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b" returned: 0 in 0.635s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.128s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-01173165-d69b-464c-94de-ff4ac7f1fb33 tempest-SnapshotsActionsTest-1190534978 None] Create snapshot completed successfully Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Flow 'volume_create_manager' (8bce272f-d14c-4df6-b215-ccd8ac2b70e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720fa4ac-0e4e-4f19-a1f8-b9fc03764974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720fa4ac-0e4e-4f19-a1f8-b9fc03764974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1020809191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9ef78b-4162-4061-8617-25f9c91fb6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572b31c16c740c6913349d4cc7519b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:38Z,use_quota=True,user_id='c44b401cf47c4fb8b4f52255381adac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd0c805-36ba-41fd-aedf-3e463bccb4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd0c805-36ba-41fd-aedf-3e463bccb4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033aef09-3274-437c-b358-c704f364b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033aef09-3274-437c-b358-c704f364b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9ef78b-4162-4061-8617-25f9c91fb6bc', 'volume_name': 'volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2170b9-8192-48ff-8c94-347483cbe8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2170b9-8192-48ff-8c94-347483cbe8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b04d4b-9a4a-44d9-a7dd-7e53752952dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:37 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Volume 8e9ef78b-4162-4061-8617-25f9c91fb6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc', 'volume_size': 1} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1020809191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9ef78b-4162-4061-8617-25f9c91fb6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572b31c16c740c6913349d4cc7519b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:38Z,use_quota=True,user_id='c44b401cf47c4fb8b4f52255381adac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Creating volume 8e9ef78b-4162-4061-8617-25f9c91fb6bc {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:37 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:54:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[84432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc 1073741824 Apr 21 20:54:37 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc 1073741824" returned: 0 in 0.604s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc Apr 21 20:54:38 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-613e2cc5-5d82-44fd-909c-c02f098e145b-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-613e2cc5-5d82-44fd-909c-c02f098e145b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-613e2cc5-5d82-44fd-909c-c02f098e145b" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-613e2cc5-5d82-44fd-909c-c02f098e145b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Deleting offline snapshot 613e2cc5-5d82-44fd-909c-c02f098e145b of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] snapshot_file for this snap is: volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e5884a-380e-4f68-b5ca-62b9976333a4]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:39 devstack sudo[84452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b Apr 21 20:54:39 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:39 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc" returned: 0 in 0.692s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b04d4b-9a4a-44d9-a7dd-7e53752952dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b91e4d-ccbf-4a06-9b27-729178473fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:39 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Volume volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc (8e9ef78b-4162-4061-8617-25f9c91fb6bc): created successfully Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b91e4d-ccbf-4a06-9b27-729178473fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Flow 'volume_create_manager' (8bce272f-d14c-4df6-b215-ccd8ac2b70e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:39 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3291517b-2df8-4516-82bc-386ae4697aa6 tempest-DeleteServersTestJSON-602555294 None] Created volume successfully. Apr 21 20:54:39 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b" returned: 0 in 0.656s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b80a6-249c-400e-9af5-3ade1aac38d0]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:39 devstack sudo[84480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:39 devstack sudo[84480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:40 devstack sudo[84480]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.667s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:40 devstack sudo[84491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b Apr 21 20:54:40 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:41 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b" returned: 0 in 1.074s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:41 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b Apr 21 20:54:41 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:42 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.613e2cc5-5d82-44fd-909c-c02f098e145b" returned: 0 in 0.680s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-613e2cc5-5d82-44fd-909c-c02f098e145b" released by "_delete_snapshot" :: held 3.172s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" released by "delete_snapshot" :: held 3.188s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:42 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Created reservations ['14eb9bee-026f-4cd0-9086-8e5ad9b6ae6a', '1a69456c-58e0-4ac4-bcd0-5590beee67e6', 'ab537a39-7028-4509-b0d5-fe27a7940e60', '27836554-d783-427e-9537-dbede8b79bc7'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:42 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Delete snapshot completed successfully. Apr 21 20:54:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-23648285-cb56-460a-b346-7390d988c9a9 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-613e2cc5-5d82-44fd-909c-c02f098e145b-delete_snapshot" released by "delete_snapshot" :: held 3.362s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Creating offline snapshot 604d141f-0ef3-4cd8-a6e0-dae33a9ed01f of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:43 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f90aa7-306b-4eef-aeb2-a77bf3c5405c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:43 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:43 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:44 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 1.165s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f 1G Apr 21 20:54:44 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f 1G" returned: 0 in 0.763s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[84530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f Apr 21 20:54:45 devstack sudo[84530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack sudo[84530]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" returned: 0 in 0.643s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f is being set with open permissions: ugo+rw Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[84535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f Apr 21 20:54:46 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" returned: 0 in 0.709s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.416s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.056s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd6880-f697-4ae3-ab11-7642e3226d56]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d1eb9786-836b-41e1-9b51-dfea63b97771 tempest-SnapshotsActionsTest-1190534978 None] Create snapshot completed successfully Apr 21 20:54:47 devstack sudo[84538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc Apr 21 20:54:47 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc" returned: 0 in 0.750s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207', 'name': 'volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df08d7ed-825b-4d04-a479-4e35630434d8', 'enforce_multipath': True} {{(pid=82005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:54:47 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-9dbd63e1-5933-4b6a-ae1c-7dfaca33e5ad req-72ec791e-105d-4e01-9e53-c70423aed03f tempest-DeleteServersTestJSON-602555294 None] attachment_update completed successfully. Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-604d141f-0ef3-4cd8-a6e0-dae33a9ed01f-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-604d141f-0ef3-4cd8-a6e0-dae33a9ed01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Acquiring lock "cinder-quobyte-604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Deleting offline snapshot 604d141f-0ef3-4cd8-a6e0-dae33a9ed01f of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] snapshot_file for this snap is: volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da7ed0d-33b9-4634-99a2-1ec117746a3b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:48 devstack sudo[84543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f Apr 21 20:54:48 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:48 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" returned: 0 in 0.607s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd491a-be8f-4fdb-aee3-a83f10fe92d2]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:48 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:48 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.719s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[84558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f Apr 21 20:54:49 devstack sudo[84558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[84558]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" returned: 0 in 0.820s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[84563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f Apr 21 20:54:50 devstack sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack sudo[84563]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" returned: 0 in 0.746s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-604d141f-0ef3-4cd8-a6e0-dae33a9ed01f" released by "_delete_snapshot" :: held 3.047s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" released by "delete_snapshot" :: held 3.120s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Created reservations ['9ca8edf8-a5bd-4c5c-8266-63e80327e1ff', '5ee64a14-54df-4306-a166-aa0a91c47dbb', '8cef37b2-f597-48b2-a2d1-18ed039430fa', '47827d0b-d09d-4c79-8290-e7c12fae7e06'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Delete snapshot completed successfully. Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a84ba253-c3e4-47f7-be91-ae104845ab41 tempest-SnapshotsActionsTest-97529180 None] Lock "cinder-604d141f-0ef3-4cd8-a6e0-dae33a9ed01f-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Flow 'volume_create_manager' (6d1a17a9-3ddc-4ca0-ac6f-c388ddd9e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91986b04-7433-44fe-8b11-aeb87438cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91986b04-7433-44fe-8b11-aeb87438cc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004b5f23-20bd-42dd-9638-7f9779706254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b867972db48c479aa68d28514c0bd627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='6b26708980654edc8b012349f7ef685a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3c06ff-ba9e-453c-b839-263e63f8eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3c06ff-ba9e-453c-b839-263e63f8eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0b9e26-7044-4b61-82c2-432c4b1d8b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[82005]: DEBUG cinder.image.glance [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Creating Keystone auth plugin from conf {{(pid=82005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:54:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0b9e26-7044-4b61-82c2-432c4b1d8b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '004b5f23-20bd-42dd-9638-7f9779706254', 'volume_name': 'volume-004b5f23-20bd-42dd-9638-7f9779706254', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc917bad-c919-4a08-9cc5-6417b3df475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc917bad-c919-4a08-9cc5-6417b3df475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa763a8-74ea-4af3-8449-8c0fecaec1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Volume 004b5f23-20bd-42dd-9638-7f9779706254: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-004b5f23-20bd-42dd-9638-7f9779706254', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:54:52 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Trying to clone 004b5f23-20bd-42dd-9638-7f9779706254 from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]). {{(pid=82005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "cinder-40780a8a-eed9-4d1c-9a0d-5698574c2b10-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-40780a8a-eed9-4d1c-9a0d-5698574c2b10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "cinder-quobyte-40780a8a-eed9-4d1c-9a0d-5698574c2b10" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-quobyte-40780a8a-eed9-4d1c-9a0d-5698574c2b10" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Deleting offline snapshot 40780a8a-eed9-4d1c-9a0d-5698574c2b10 of volume 1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] snapshot_file for this snap is: volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:54:53 devstack cinder-volume[82005]: INFO cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfccf77-4982-4ce4-a722-7cd1b70733e1]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a675c252-7c87-478b-800a-1eafbc5f98a9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack sudo[84621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:53 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD Apr 21 20:54:53 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.717s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41eddf4-2e6f-4ff5-aa89-bdd4d3451c56]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f is fetched for user 6b26708980654edc8b012349f7ef685a. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:54:54 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 Apr 21 20:54:54 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[43305af6-4fd0-4d4d-9c64-f8c4c3e79b24]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD Apr 21 20:54:54 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" returned: 0 in 0.813s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004b5f23-20bd-42dd-9638-7f9779706254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b867972db48c479aa68d28514c0bd627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='6b26708980654edc8b012349f7ef685a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Creating volume 004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:54 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:54:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:54 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 1073741824 Apr 21 20:54:54 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.682s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10 Apr 21 20:54:55 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 1073741824" returned: 0 in 1.058s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[84660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:54:56 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87.40780a8a-eed9-4d1c-9a0d-5698574c2b10" returned: 0 in 0.727s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-quobyte-40780a8a-eed9-4d1c-9a0d-5698574c2b10" released by "_delete_snapshot" :: held 3.079s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" released by "delete_snapshot" :: held 3.117s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Created reservations ['d49cada2-d4e4-4f36-a8b1-768ac662df1c', '38dfbf87-3481-47f4-82e4-f7836125ef88', 'be9f150b-526a-42d9-a778-5f410b42b1c8', 'a90513c6-91ca-4a44-ba7e-f30d0f15f0e2'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:56 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Delete snapshot completed successfully. Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c1e87ba-a4ac-4b32-bb4c-450dc2971989 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-40780a8a-eed9-4d1c-9a0d-5698574c2b10-delete_snapshot" released by "delete_snapshot" :: held 3.256s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:56 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-d07ed648-6434-4da6-b39a-c2ee3eb05e33 req-2001e2b0-a69c-4a5d-a188-8b6d55dac513 tempest-DeleteServersTestJSON-602555294 None] Terminate volume connection completed successfully. Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-d07ed648-6434-4da6-b39a-c2ee3eb05e33 req-2001e2b0-a69c-4a5d-a188-8b6d55dac513 tempest-DeleteServersTestJSON-602555294 None] Deleting attachment df08d7ed-825b-4d04-a479-4e35630434d8. {{(pid=82005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:54:56 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 0 in 0.613s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Attempting download of 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume 004b5f23-20bd-42dd-9638-7f9779706254. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a96e6e4-7fe4-4e62-830a-e958c5e228a1]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i Apr 21 20:54:56 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i" returned: 0 in 0.550s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:57 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i Apr 21 20:54:57 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "cinder-1af0d5a6-280c-45f8-a9b6-23e435ba1e87-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-1af0d5a6-280c-45f8-a9b6-23e435ba1e87-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" acquired by "delete_volume" :: waited 0.042s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b7735-564c-40b4-8286-ac82fb2d447e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:57 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 Apr 21 20:54:57 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i" returned: 1 in 0.790s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_biav3o2i' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4154f36-5a22-4086-8376-0484646aa2f7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[84680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD Apr 21 20:54:58 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" returned: 0 in 0.782s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[84700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87 Apr 21 20:54:58 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f was qcow2, converting to raw {{(pid=82005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:54:58 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" returned: 0 in 0.459s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-quobyte-1af0d5a6-280c-45f8-a9b6-23e435ba1e87" released by "delete_volume" :: held 1.336s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:58 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Created reservations ['ea8d995c-c687-47c3-9c6b-b6f96cfaa872', '349f39b7-6435-41f0-a17c-bbf3441a9e9d', 'bd94d265-4d60-40c9-8238-095ddb96714d', 'd6c7ce88-4e5f-4a28-aa9c-1e04c5b61357'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:54:59 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.616s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Deleted volume successfully. Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-29cbe93a-822c-4241-81cf-253b30ddf939 tempest-SnapshotsActionsTest-1190534978 None] Lock "cinder-1af0d5a6-280c-45f8-a9b6-23e435ba1e87-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:59 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 0 in 1.214s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_nr1e1irodevstack@QuobyteHD, size 112.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:59 devstack cinder-volume[82005]: INFO cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Converted 112.00 MB image at 92.23 MB/s Apr 21 20:54:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 1G Apr 21 20:54:59 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 1G" returned: 0 in 0.608s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d3e16-5197-4d7d-b149-6fbf3d5d0c8b]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Acquiring lock "cinder-8e9ef78b-4162-4061-8617-25f9c91fb6bc-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Lock "cinder-8e9ef78b-4162-4061-8617-25f9c91fb6bc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Acquiring lock "cinder-quobyte-8e9ef78b-4162-4061-8617-25f9c91fb6bc" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Lock "cinder-quobyte-8e9ef78b-4162-4061-8617-25f9c91fb6bc" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcaeb34-1b60-4b43-a810-e6edb5c03a96]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:00 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[84737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc Apr 21 20:55:00 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 0 in 0.864s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc" returned: 0 in 0.822s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:01 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc Apr 21 20:55:01 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 1 in 0.603s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Downloaded image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume 004b5f23-20bd-42dd-9638-7f9779706254 successfully. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:55:01 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f for user 6b26708980654edc8b012349f7ef685a is deleted. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Marking volume 004b5f23-20bd-42dd-9638-7f9779706254 as bootable. {{(pid=82005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=58,cinder:UPDATE=72,cinder:DELETE=6,cinder:INSERT=20 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:02 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e9ef78b-4162-4061-8617-25f9c91fb6bc" returned: 0 in 0.587s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Copying metadata from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f to 004b5f23-20bd-42dd-9638-7f9779706254. {{(pid=82005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Creating volume glance metadata for volume 004b5f23-20bd-42dd-9638-7f9779706254 backed by image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Lock "cinder-quobyte-8e9ef78b-4162-4061-8617-25f9c91fb6bc" released by "delete_volume" :: held 1.462s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa763a8-74ea-4af3-8449-8c0fecaec1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004b5f23-20bd-42dd-9638-7f9779706254', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d742fe0d-449e-4160-99ab-d6134591caf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Volume volume-004b5f23-20bd-42dd-9638-7f9779706254 (004b5f23-20bd-42dd-9638-7f9779706254): created successfully Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d742fe0d-449e-4160-99ab-d6134591caf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Flow 'volume_create_manager' (6d1a17a9-3ddc-4ca0-ac6f-c388ddd9e3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-60fa6d33-9d51-4215-8934-75334e9669fd tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Created volume successfully. Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Created reservations ['2e53847f-22fd-4568-a509-1f92aeb59541', '2d41a7ca-5426-463c-ba89-247d427f6812', '2c1deb08-2cd2-4f3e-ac22-4d602053f826', '52729380-b5f4-4bf1-9a26-7d5cc13b2194'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[84753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:02 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.568s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Deleted volume successfully. Apr 21 20:55:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-42a35586-2b98-48ac-89bc-bc48367fb531 tempest-DeleteServersTestJSON-602555294 None] Lock "cinder-8e9ef78b-4162-4061-8617-25f9c91fb6bc-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:04 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=64,cinder:SELECT=91,cinder:INSERT=29,cinder:DELETE=5 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:04 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3768e3a8-2144-42a6-93d8-b1629fd313cc]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:04 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:05 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 0 in 0.736s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:05 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:05 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 1 in 0.774s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.564s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207', 'name': 'volume-004b5f23-20bd-42dd-9638-7f9779706254', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa21ac34-0be8-493d-bbbe-2d73a2dd6733', 'enforce_multipath': True} {{(pid=82005) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:55:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-b2f102ce-28fe-48e3-bcbe-65a605ce2a28 req-29ec1f91-52df-42e7-9075-5b2a74a08a72 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] attachment_update completed successfully. Apr 21 20:55:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a12733f5-3cee-4efd-ae64-eb8287c66e95 tempest-GroupsV314Test-978203178 None] Group tempest-GroupsV314Test-Group-1594005848: creating Apr 21 20:55:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a12733f5-3cee-4efd-ae64-eb8287c66e95 tempest-GroupsV314Test-978203178 None] Group tempest-GroupsV314Test-Group-1594005848: created successfully Apr 21 20:55:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a12733f5-3cee-4efd-ae64-eb8287c66e95 tempest-GroupsV314Test-978203178 None] Create group completed successfully. Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Flow 'volume_create_manager' (c02c9a14-9197-48df-ab09-ca8807495eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd6d294-f479-4666-b69e-b463279edb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd6d294-f479-4666-b69e-b463279edb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352100775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61bb5d33-e524-4ecf-9a56-9997772daa48,host='devstack@QuobyteHD#QuobyteHD',id=9a562e99-1fa8-48df-8f1e-819f4f41fb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53aa3977b5c47ad935151130713c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:12Z,use_quota=True,user_id='c2bbfc1dd69e419a8e4da3ae1d4e6035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ad32a8d-49a9-4eab-8cf9-cad243058c3d),volume_type_id=6ad32a8d-49a9-4eab-8cf9-cad243058c3d)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d49416-d0e0-455c-ad75-8fe4f8db9871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d49416-d0e0-455c-ad75-8fe4f8db9871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ecea57-24dc-4226-841b-0cb46343f0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ecea57-24dc-4226-841b-0cb46343f0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a562e99-1fa8-48df-8f1e-819f4f41fb22', 'volume_name': 'volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8872fb77-3047-4027-8aff-99c52a95df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8872fb77-3047-4027-8aff-99c52a95df15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46af3e76-117d-45ab-be37-f60af75260b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:11 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Volume 9a562e99-1fa8-48df-8f1e-819f4f41fb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22', 'volume_size': 1} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61bb5d33-e524-4ecf-9a56-9997772daa48,created_at=2026-04-21T18:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352100775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61bb5d33-e524-4ecf-9a56-9997772daa48,host='devstack@QuobyteHD#QuobyteHD',id=9a562e99-1fa8-48df-8f1e-819f4f41fb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53aa3977b5c47ad935151130713c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:12Z,use_quota=True,user_id='c2bbfc1dd69e419a8e4da3ae1d4e6035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ad32a8d-49a9-4eab-8cf9-cad243058c3d),volume_type_id=6ad32a8d-49a9-4eab-8cf9-cad243058c3d)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Creating volume 9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:11 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:55:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:11 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 1073741824 Apr 21 20:55:11 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:12 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 1073741824" returned: 0 in 1.196s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:13 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:13 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 0.582s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46af3e76-117d-45ab-be37-f60af75260b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631f2c2c-f9b3-4fc2-aac1-f0494303b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:13 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Volume volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 (9a562e99-1fa8-48df-8f1e-819f4f41fb22): created successfully Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631f2c2c-f9b3-4fc2-aac1-f0494303b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Flow 'volume_create_manager' (c02c9a14-9197-48df-ab09-ca8807495eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:13 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-42e4eb1f-05f9-4aec-8d35-d3da3a3fde96 tempest-GroupsV314Test-978203178 None] Created volume successfully. Apr 21 20:55:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:15 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Cloning volume 9a562e99-1fa8-48df-8f1e-819f4f41fb22 to volume fa019bef-ef5d-4576-9665-041e10a9cddb Apr 21 20:55:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Creating offline snapshot 0fbb2cae-28ec-41a5-b71c-3f113f017fe2 of volume 9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01e1ea-b159-412b-b038-6e70d209068f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:15 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:15 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:16 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 1.052s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:16 devstack sudo[85112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 1G Apr 21 20:55:16 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:17 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 1G" returned: 0 in 0.719s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:17 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 Apr 21 20:55:17 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:18 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:18 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:55:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:18 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 Apr 21 20:55:18 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:18 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2" returned: 0 in 0.691s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:18 devstack sudo[85151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info Apr 21 20:55:18 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info" returned: 0 in 0.422s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[85155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info Apr 21 20:55:19 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.info" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Acquiring lock "cinder-quobyte-fa019bef-ef5d-4576-9665-041e10a9cddb" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-fa019bef-ef5d-4576-9665-041e10a9cddb" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] snapshot: 0fbb2cae-28ec-41a5-b71c-3f113f017fe2, volume: fa019bef-ef5d-4576-9665-041e10a9cddb, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0755df1-3bd8-48f2-8f64-4d2ba0202e4b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 Apr 21 20:55:19 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:20 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2" returned: 0 in 0.573s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:55:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:55:20 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1c5058-7d11-4d22-9f2c-30d995b19dd9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:20 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:20 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 0.604s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:21 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:55:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack sudo[85188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb Apr 21 20:55:21 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb" returned: 0 in 3.157s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:24 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e8d29-1e7f-4daa-ae62-c8554a7076fd]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:24 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:24 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 0.880s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22, size 1024.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:25 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Converted 1024.00 MB image at 324.21 MB/s Apr 21 20:55:25 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb Apr 21 20:55:25 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb" returned: 0 in 0.656s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-fa019bef-ef5d-4576-9665-041e10a9cddb" released by "_copy_volume_from_snapshot" :: held 5.957s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Acquiring lock "cinder-quobyte-0fbb2cae-28ec-41a5-b71c-3f113f017fe2" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-0fbb2cae-28ec-41a5-b71c-3f113f017fe2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Deleting offline snapshot 0fbb2cae-28ec-41a5-b71c-3f113f017fe2 of volume 9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] snapshot_file for this snap is: volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[48af1ae7-1bd2-46d3-9116-aa5bfb40c070]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 Apr 21 20:55:26 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:26 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2" returned: 0 in 0.872s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:26 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ead80a-913c-482e-97c2-cb2ebd82602b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:26 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 0.877s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 Apr 21 20:55:27 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2" returned: 0 in 1.029s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2 Apr 21 20:55:28 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:29 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22.0fbb2cae-28ec-41a5-b71c-3f113f017fe2" returned: 0 in 0.537s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-0fbb2cae-28ec-41a5-b71c-3f113f017fe2" released by "_delete_snapshot" :: held 3.473s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.743s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4fc397fa-6a37-407a-af8e-1ece63938273 tempest-GroupsV314Test-978203178 None] Create group from source-group-61bb5d33-e524-4ecf-9a56-9997772daa48 completed successfully. Apr 21 20:55:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Acquiring lock "cinder-quobyte-fa019bef-ef5d-4576-9665-041e10a9cddb" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-fa019bef-ef5d-4576-9665-041e10a9cddb" acquired by "delete_volume" :: waited 0.021s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dde20a-562a-4528-9ec1-9dcc71ed5add]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb Apr 21 20:55:31 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:32 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb" returned: 0 in 1.309s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:32 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb Apr 21 20:55:32 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:33 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fa019bef-ef5d-4576-9665-041e10a9cddb" returned: 0 in 1.039s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-fa019bef-ef5d-4576-9665-041e10a9cddb" released by "delete_volume" :: held 2.449s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Created reservations ['36566b65-bf09-471a-b41f-0d7f3156e750'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:33 devstack cinder-volume[82005]: WARNING cinder.quota [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1696433285 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1696433285, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:33 devstack cinder-volume[82005]: WARNING cinder.quota [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1696433285 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1696433285, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Created reservations ['ebfbfbc6-cd9d-412c-aadf-6441cfe5fb3c', '95a72068-d9e0-4118-b9e4-0b806708989e', '1ef5752f-0d24-45ad-8ade-c7b6c12f1c28', '3e9ea2fc-fb84-4f4c-adde-20402592b65a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:33 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:33 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 1.139s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:34 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3a26547d-3a05-40b3-8141-2c97a9b24291 tempest-GroupsV314Test-978203178 None] Delete group completed successfully. Apr 21 20:55:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Acquiring lock "cinder-quobyte-9a562e99-1fa8-48df-8f1e-819f4f41fb22" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-9a562e99-1fa8-48df-8f1e-819f4f41fb22" acquired by "delete_volume" :: waited 0.060s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca0433-1226-4780-b769-2e6c37eee78e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:35 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:35 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:36 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 0.940s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:36 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22 Apr 21 20:55:36 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:36 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:36 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:37 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.829s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:37 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9a562e99-1fa8-48df-8f1e-819f4f41fb22" returned: 0 in 0.967s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Lock "cinder-quobyte-9a562e99-1fa8-48df-8f1e-819f4f41fb22" released by "delete_volume" :: held 1.999s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Created reservations ['5655c0f5-4dc1-4b01-9fc3-ce4d4ac39871'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Created reservations ['00ee44fd-a401-42f3-8617-241c5caad663', '0d35ba92-d3a6-434f-bff6-61fb62db3062', 'be90b813-f422-4cd7-92d7-6ff156ee216a', 'deb74d0c-1099-4b84-a972-921e2626d24d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:37 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:37 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-0d101278-0b70-485b-9f89-941b631a3085 req-43dc03f6-abd6-4c08-8acf-f94e45bd97ed tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Terminate volume connection completed successfully. Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-0d101278-0b70-485b-9f89-941b631a3085 req-43dc03f6-abd6-4c08-8acf-f94e45bd97ed tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Deleting attachment fa21ac34-0be8-493d-bbbe-2d73a2dd6733. {{(pid=82005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:55:38 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.549s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c3210e0d-7abc-49aa-9016-acb3eaf1591a tempest-GroupsV314Test-978203178 None] Delete group completed successfully. Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "cinder-004b5f23-20bd-42dd-9638-7f9779706254-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-004b5f23-20bd-42dd-9638-7f9779706254-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "cinder-quobyte-004b5f23-20bd-42dd-9638-7f9779706254" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-quobyte-004b5f23-20bd-42dd-9638-7f9779706254" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc116b7-9363-4f7f-9f1a-1ce7edbb4946]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:38 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:38 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 0 in 0.740s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:39 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 1 in 0.673s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254 Apr 21 20:55:40 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-004b5f23-20bd-42dd-9638-7f9779706254" returned: 0 in 0.584s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-quobyte-004b5f23-20bd-42dd-9638-7f9779706254" released by "delete_volume" :: held 2.059s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG cinder.quota [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Created reservations ['58820f05-83bd-495d-85fe-81c57e2219a2', '23a40c81-b95c-4550-80f4-2bce55fe5f00', 'fb980ad5-3ef2-487b-95cd-02fa4307f321', '9e659fc5-c6b9-41a7-908c-cc2180ed04fe'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:40 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.641s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[82005]: DEBUG cinder.manager [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Deleted volume successfully. Apr 21 20:55:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-0d101278-0b70-485b-9f89-941b631a3085 req-22f055d7-e5e8-436b-8431-12608645596f tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-004b5f23-20bd-42dd-9638-7f9779706254-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Flow 'volume_create_manager' (5fff0df9-3d2c-4ac6-9a9d-955e6869c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba4717f-94ca-46d5-a414-7a1518ba91af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba4717f-94ca-46d5-a414-7a1518ba91af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1219368183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3659b97c-4d7e-4e5a-b397-42de137dfdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3019df4f7dc240c680af5511247103a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:45Z,use_quota=True,user_id='263e1bcf98ec40c0bf4e360977d9dce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a813fc2-3e9e-4181-9dd7-83fda7e734d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a813fc2-3e9e-4181-9dd7-83fda7e734d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dfb111-7ef2-43b6-8b19-c989b5751b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dfb111-7ef2-43b6-8b19-c989b5751b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3659b97c-4d7e-4e5a-b397-42de137dfdc5', 'volume_name': 'volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b49acf-7d94-4e12-8433-c54f5d1af515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b49acf-7d94-4e12-8433-c54f5d1af515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08869ef6-e48d-40ed-8416-2d58cfaeecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Volume 3659b97c-4d7e-4e5a-b397-42de137dfdc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5', 'volume_size': 1} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1219368183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3659b97c-4d7e-4e5a-b397-42de137dfdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3019df4f7dc240c680af5511247103a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:45Z,use_quota=True,user_id='263e1bcf98ec40c0bf4e360977d9dce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Creating volume 3659b97c-4d7e-4e5a-b397-42de137dfdc5 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:44 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:55:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 1073741824 Apr 21 20:55:44 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:45 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 1073741824" returned: 0 in 0.908s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 Apr 21 20:55:45 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:46 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5" returned: 0 in 0.962s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08869ef6-e48d-40ed-8416-2d58cfaeecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c7bcae-a49b-408a-a89a-f0c8e2d96b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Volume volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 (3659b97c-4d7e-4e5a-b397-42de137dfdc5): created successfully Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c7bcae-a49b-408a-a89a-f0c8e2d96b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Flow 'volume_create_manager' (5fff0df9-3d2c-4ac6-9a9d-955e6869c08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b5b43c1d-6747-496d-ba33-7a183240b9b0 tempest-ServersNegativeTestJSON-1702436157 None] Created volume successfully. Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Flow 'volume_create_manager' (346d5093-9965-4fee-9092-e92d4d3bb438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0086e0f-05e7-4dc7-aa71-60b202b70e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0086e0f-05e7-4dc7-aa71-60b202b70e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-724191317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b65cbe-070b-49ae-8433-91180f7b145e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3019df4f7dc240c680af5511247103a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:49Z,use_quota=True,user_id='263e1bcf98ec40c0bf4e360977d9dce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d76a51-fad8-4175-ab7a-3e099731b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d76a51-fad8-4175-ab7a-3e099731b552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edda52ae-fa62-40be-83ca-8182d33a7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edda52ae-fa62-40be-83ca-8182d33a7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b65cbe-070b-49ae-8433-91180f7b145e', 'volume_name': 'volume-58b65cbe-070b-49ae-8433-91180f7b145e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7fe173-85a6-4e75-a8f1-92467b9e5e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7fe173-85a6-4e75-a8f1-92467b9e5e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17166af2-d6ba-4569-874d-441d2c994e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:48 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Volume 58b65cbe-070b-49ae-8433-91180f7b145e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b65cbe-070b-49ae-8433-91180f7b145e', 'volume_size': 1} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-724191317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b65cbe-070b-49ae-8433-91180f7b145e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3019df4f7dc240c680af5511247103a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:49Z,use_quota=True,user_id='263e1bcf98ec40c0bf4e360977d9dce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Creating volume 58b65cbe-070b-49ae-8433-91180f7b145e {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:48 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:55:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e 1073741824 Apr 21 20:55:48 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e 1073741824" returned: 0 in 0.685s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:49 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e Apr 21 20:55:49 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Flow 'volume_create_manager' (f8875d4b-0a7a-4e2d-8704-baa7960f5c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806c6ed-3bb9-4da3-906c-0b9d44784f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806c6ed-3bb9-4da3-906c-0b9d44784f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1835229994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deab769-e619-4c71-840b-ffa5936a6bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0f6bc9a1644f0fae2cffe765250d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:50Z,use_quota=True,user_id='a9bf6d3270ba408cbd3d824c81f7d1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e071a62-29d2-420a-ba65-da7efe835b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e071a62-29d2-420a-ba65-da7efe835b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9adaf8c-2106-4480-90bf-426f50bdf2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:50 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9adaf8c-2106-4480-90bf-426f50bdf2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8deab769-e619-4c71-840b-ffa5936a6bd1', 'volume_name': 'volume-8deab769-e619-4c71-840b-ffa5936a6bd1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c30ed5f-511e-4b4e-8fda-be46e4c3eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c30ed5f-511e-4b4e-8fda-be46e4c3eca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b348d2d-da8c-487c-b6bf-bf3779c61c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Volume 8deab769-e619-4c71-840b-ffa5936a6bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8deab769-e619-4c71-840b-ffa5936a6bd1', 'volume_size': 1} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e" returned: 0 in 0.635s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1835229994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deab769-e619-4c71-840b-ffa5936a6bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0f6bc9a1644f0fae2cffe765250d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:50Z,use_quota=True,user_id='a9bf6d3270ba408cbd3d824c81f7d1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Creating volume 8deab769-e619-4c71-840b-ffa5936a6bd1 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:50 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17166af2-d6ba-4569-874d-441d2c994e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b65cbe-070b-49ae-8433-91180f7b145e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727583a-3609-4133-81e7-711050a32374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:50 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 1073741824 Apr 21 20:55:50 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Volume volume-58b65cbe-070b-49ae-8433-91180f7b145e (58b65cbe-070b-49ae-8433-91180f7b145e): created successfully Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727583a-3609-4133-81e7-711050a32374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Flow 'volume_create_manager' (346d5093-9965-4fee-9092-e92d4d3bb438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:50 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-98044c01-193a-41d7-b001-39ed513ddd2b tempest-ServersNegativeTestJSON-1702436157 None] Created volume successfully. Apr 21 20:55:50 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 1073741824" returned: 0 in 0.580s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:50 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 Apr 21 20:55:50 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "cinder-58b65cbe-070b-49ae-8433-91180f7b145e-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-58b65cbe-070b-49ae-8433-91180f7b145e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "cinder-quobyte-58b65cbe-070b-49ae-8433-91180f7b145e" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-quobyte-58b65cbe-070b-49ae-8433-91180f7b145e" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eab8ff-47a3-4557-b0f1-7eba714c2373]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e Apr 21 20:55:51 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:51 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1" returned: 0 in 0.614s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b348d2d-da8c-487c-b6bf-bf3779c61c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8deab769-e619-4c71-840b-ffa5936a6bd1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704e8cb6-c7ca-438c-a750-9275a4c459db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:51 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Volume volume-8deab769-e619-4c71-840b-ffa5936a6bd1 (8deab769-e619-4c71-840b-ffa5936a6bd1): created successfully Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704e8cb6-c7ca-438c-a750-9275a4c459db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Flow 'volume_create_manager' (f8875d4b-0a7a-4e2d-8704-baa7960f5c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-dc3251dc-e7a7-4545-865f-265b605fd75b tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Created volume successfully. Apr 21 20:55:51 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e Apr 21 20:55:51 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-58b65cbe-070b-49ae-8433-91180f7b145e" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-quobyte-58b65cbe-070b-49ae-8433-91180f7b145e" released by "delete_volume" :: held 1.042s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Created reservations ['f5a64d26-a7fb-4609-99f7-56b3fd261c67', 'a70713f7-ac40-4dd5-a13b-1acecd9d278d', 'bc4ddaa7-b57c-48d3-80a9-9681f75cdb41', '77e4d77f-07b7-4ceb-a8c8-0a66e1093c4d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:52 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:52 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:53 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Deleted volume successfully. Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2c8659b5-c0e4-4db5-a0f5-5f64549b48ef tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-58b65cbe-070b-49ae-8433-91180f7b145e-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Acquiring lock "cinder-8deab769-e619-4c71-840b-ffa5936a6bd1-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "cinder-8deab769-e619-4c71-840b-ffa5936a6bd1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Acquiring lock "cinder-quobyte-8deab769-e619-4c71-840b-ffa5936a6bd1" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "cinder-quobyte-8deab769-e619-4c71-840b-ffa5936a6bd1" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1bc1c6-1d87-4d4a-ad3d-421e56369b5c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:53 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 Apr 21 20:55:53 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "cinder-3659b97c-4d7e-4e5a-b397-42de137dfdc5-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-3659b97c-4d7e-4e5a-b397-42de137dfdc5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "cinder-quobyte-3659b97c-4d7e-4e5a-b397-42de137dfdc5" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-quobyte-3659b97c-4d7e-4e5a-b397-42de137dfdc5" acquired by "delete_volume" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ff02b-b423-4273-9609-840a77037906]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:53 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 Apr 21 20:55:53 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1" returned: 0 in 0.674s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:54 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1 Apr 21 20:55:54 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5" returned: 0 in 0.696s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:54 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5 Apr 21 20:55:54 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8deab769-e619-4c71-840b-ffa5936a6bd1" returned: 0 in 0.461s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "cinder-quobyte-8deab769-e619-4c71-840b-ffa5936a6bd1" released by "delete_volume" :: held 1.164s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Created reservations ['79b72453-ea8a-49ee-b67b-9e2db978651d', 'e64f987c-2bd0-4167-a0d9-7ce7bd12d81f', '111cb98f-393a-4584-916c-117fbe2b1a81', 'ad179f07-87e8-48b7-a6dd-3e5d40856919'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:54 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:54 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3659b97c-4d7e-4e5a-b397-42de137dfdc5" returned: 0 in 0.504s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-quobyte-3659b97c-4d7e-4e5a-b397-42de137dfdc5" released by "delete_volume" :: held 1.233s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:54 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1388e1e3-3a26-49de-9158-5da878a1c79a tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Terminate volume connection completed successfully. Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1388e1e3-3a26-49de-9158-5da878a1c79a tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Deleting attachment 167638ad-d21e-4f95-8137-d11c58a508c3. {{(pid=82005) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:55:54 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Created reservations ['4ae4caf5-4e34-4ebf-939c-30fea46bd6da', '9ac8365a-100b-4a11-9716-10d3e631427c', 'bc837450-9b87-49d3-a175-805e64c9136a', '5b8f4952-7290-421e-8ff2-73a0371cf50e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:55 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:55 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:55 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.534s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Deleted volume successfully. Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c6955bc-7469-45f3-ad19-eeb663fd9cd6 tempest-VolumeQuotasNegativeTestJSON-1081482740 None] Lock "cinder-8deab769-e619-4c71-840b-ffa5936a6bd1-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "cinder-9897b6e8-b869-441b-b1bf-c307c5d275ec-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-9897b6e8-b869-441b-b1bf-c307c5d275ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:55 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.498s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Deleted volume successfully. Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5d360d51-6a9c-4487-bd2e-626e665a9901 tempest-ServersNegativeTestJSON-1702436157 None] Lock "cinder-3659b97c-4d7e-4e5a-b397-42de137dfdc5-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "cinder-quobyte-9897b6e8-b869-441b-b1bf-c307c5d275ec" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-quobyte-9897b6e8-b869-441b-b1bf-c307c5d275ec" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183a2bd-8c93-4e0c-9ff3-a7dd02fc6f8f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:55 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec Apr 21 20:55:55 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec" returned: 0 in 0.675s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec Apr 21 20:55:56 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9897b6e8-b869-441b-b1bf-c307c5d275ec" returned: 0 in 0.514s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-quobyte-9897b6e8-b869-441b-b1bf-c307c5d275ec" released by "delete_volume" :: held 1.210s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG cinder.quota [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Created reservations ['13b73f73-9fc6-417c-9fee-cb05e93d8c57', '4b70531b-cc12-4161-985a-66d29eb619fb', '575f7e54-a382-4c28-883e-6460075e3aba', 'c785d63d-9239-4e7b-89d8-43c987cc8c84'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:55:56 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:57 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.565s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[82005]: DEBUG cinder.manager [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:57 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Deleted volume successfully. Apr 21 20:55:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-c3f9c643-d141-4863-866f-acb8b78c4e13 req-1e3a655b-2771-4d6c-81f5-2a71e1fd7eb4 tempest-ServerBootFromVolumeStableRescueTest-1354288110 None] Lock "cinder-9897b6e8-b869-441b-b1bf-c307c5d275ec-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:59 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Flow 'volume_create_manager' (47a31011-a872-4dc3-8299-1602fc786ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59215ea-8766-4912-8085-f80aa749ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59215ea-8766-4912-8085-f80aa749ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1462428160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d172cab-8cb0-41e6-b953-7ca38a3442db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993dad7247d84a80ac5d9daa6f6486c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:00Z,use_quota=True,user_id='0c916f91fba54c439c6013fb39c1a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5af74d0-f357-4db1-b294-f36714915642),volume_type_id=b5af74d0-f357-4db1-b294-f36714915642)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5251a9-6ef2-491f-90f8-a27603fd9381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5251a9-6ef2-491f-90f8-a27603fd9381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459cb841-c72c-450f-9801-067ecb1b4306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459cb841-c72c-450f-9801-067ecb1b4306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d172cab-8cb0-41e6-b953-7ca38a3442db', 'volume_name': 'volume-4d172cab-8cb0-41e6-b953-7ca38a3442db', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2761a727-9899-4d2b-acd8-75353cc2cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2761a727-9899-4d2b-acd8-75353cc2cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599296cd-398e-41b1-a895-b96658b0a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:00 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Volume 4d172cab-8cb0-41e6-b953-7ca38a3442db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d172cab-8cb0-41e6-b953-7ca38a3442db', 'volume_size': 1} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1462428160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d172cab-8cb0-41e6-b953-7ca38a3442db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993dad7247d84a80ac5d9daa6f6486c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:00Z,use_quota=True,user_id='0c916f91fba54c439c6013fb39c1a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5af74d0-f357-4db1-b294-f36714915642),volume_type_id=b5af74d0-f357-4db1-b294-f36714915642)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Creating volume 4d172cab-8cb0-41e6-b953-7ca38a3442db {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:00 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db 1073741824 Apr 21 20:56:00 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db 1073741824" returned: 0 in 0.696s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db Apr 21 20:56:00 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db" returned: 0 in 0.517s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599296cd-398e-41b1-a895-b96658b0a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d172cab-8cb0-41e6-b953-7ca38a3442db', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca1cdc7-89ba-417c-9013-afb8358a9d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Volume volume-4d172cab-8cb0-41e6-b953-7ca38a3442db (4d172cab-8cb0-41e6-b953-7ca38a3442db): created successfully Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca1cdc7-89ba-417c-9013-afb8358a9d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Flow 'volume_create_manager' (47a31011-a872-4dc3-8299-1602fc786ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9d7fde7f-4521-4b65-880d-b0ea1439d282 tempest-VolumeTypesAccessTest-1006723143 None] Created volume successfully. Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (d91e96b1-0290-4a75-b1e7-2fa9e03aca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98145823-05bd-4884-8917-03349c1521d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98145823-05bd-4884-8917-03349c1521d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1898458672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c388ab-a56c-470d-9ae7-c70e00dfee86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:02Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a10ef9-ee46-4b02-a38d-1a27acc92aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a10ef9-ee46-4b02-a38d-1a27acc92aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6540bd-8a16-4194-a0f3-8dbb4368344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6540bd-8a16-4194-a0f3-8dbb4368344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c388ab-a56c-470d-9ae7-c70e00dfee86', 'volume_name': 'volume-66c388ab-a56c-470d-9ae7-c70e00dfee86', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c836fd-ab61-4b77-92fc-09c5dbbb7fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c836fd-ab61-4b77-92fc-09c5dbbb7fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a136d96-ad02-4283-8dda-db33cedf3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Volume 66c388ab-a56c-470d-9ae7-c70e00dfee86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c388ab-a56c-470d-9ae7-c70e00dfee86', 'volume_size': 1} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1898458672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c388ab-a56c-470d-9ae7-c70e00dfee86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:02Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Creating volume 66c388ab-a56c-470d-9ae7-c70e00dfee86 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:01 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 1073741824 Apr 21 20:56:01 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Acquiring lock "cinder-4d172cab-8cb0-41e6-b953-7ca38a3442db-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Lock "cinder-4d172cab-8cb0-41e6-b953-7ca38a3442db-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=78,cinder:UPDATE=100,cinder:INSERT=20,cinder:DELETE=4 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Acquiring lock "cinder-quobyte-4d172cab-8cb0-41e6-b953-7ca38a3442db" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Lock "cinder-quobyte-4d172cab-8cb0-41e6-b953-7ca38a3442db" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647c131-cd02-4b75-983f-5abbe161277c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db Apr 21 20:56:02 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 1073741824" returned: 0 in 0.605s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 Apr 21 20:56:02 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db Apr 21 20:56:02 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86" returned: 0 in 0.411s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a136d96-ad02-4283-8dda-db33cedf3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c388ab-a56c-470d-9ae7-c70e00dfee86', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a99095d-3f5d-4c25-832d-e9f8dda45365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Volume volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 (66c388ab-a56c-470d-9ae7-c70e00dfee86): created successfully Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a99095d-3f5d-4c25-832d-e9f8dda45365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (d91e96b1-0290-4a75-b1e7-2fa9e03aca30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3c74dc8e-96ec-40a6-ac2d-de977b701e10 tempest-VolumesActionsTest-67164883 None] Created volume successfully. Apr 21 20:56:03 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4d172cab-8cb0-41e6-b953-7ca38a3442db" returned: 0 in 0.432s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Lock "cinder-quobyte-4d172cab-8cb0-41e6-b953-7ca38a3442db" released by "delete_volume" :: held 0.955s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:03 devstack cinder-volume[82005]: WARNING cinder.quota [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-26355635 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-26355635, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:03 devstack cinder-volume[82005]: WARNING cinder.quota [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-26355635 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-26355635, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Created reservations ['f632a1bd-946d-4bea-b5d8-3cfd0ee8d57b', 'a06a7227-f76e-4afc-a0d3-5012b0553df1', '69c3fef8-d9e3-48fd-895a-c66061993653', 'deab58b6-f21e-4608-97b0-b414ec5cde1f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:03 devstack sudo[85847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:03 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e7160517-2321-49dd-a646-24d678c8b12c tempest-VolumesActionsTest-67164883 None] Acquiring lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86" by "attach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.477s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Deleted volume successfully. Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e7160517-2321-49dd-a646-24d678c8b12c tempest-VolumesActionsTest-67164883 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86" acquired by "attach_volume" :: waited 0.023s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-520fd9c5-ef7b-4bf3-bcd2-8a374e27f4b6 tempest-VolumeTypesAccessTest-1006723143 None] Lock "cinder-4d172cab-8cb0-41e6-b953-7ca38a3442db-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e7160517-2321-49dd-a646-24d678c8b12c tempest-VolumesActionsTest-67164883 None] Attaching volume 66c388ab-a56c-470d-9ae7-c70e00dfee86 to instance f9f6242d-0d76-45bc-b5b1-ecd043fecd09 at mountpoint /dev/vdb on host None. Apr 21 20:56:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e7160517-2321-49dd-a646-24d678c8b12c tempest-VolumesActionsTest-67164883 None] Attach volume completed successfully. Apr 21 20:56:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e7160517-2321-49dd-a646-24d678c8b12c tempest-VolumesActionsTest-67164883 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86" released by "attach_volume" :: held 0.078s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:04 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-127ec46a-3cca-4f1f-abfb-be0fe0f40dfd tempest-VolumesActionsTest-1001619042 None] Terminate volume connection completed successfully. Apr 21 20:56:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-127ec46a-3cca-4f1f-abfb-be0fe0f40dfd tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-detach_volume" by "detach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-127ec46a-3cca-4f1f-abfb-be0fe0f40dfd tempest-VolumesActionsTest-1001619042 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-127ec46a-3cca-4f1f-abfb-be0fe0f40dfd tempest-VolumesActionsTest-1001619042 None] Detaching volume 66c388ab-a56c-470d-9ae7-c70e00dfee86 from instance f9f6242d-0d76-45bc-b5b1-ecd043fecd09. Apr 21 20:56:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-127ec46a-3cca-4f1f-abfb-be0fe0f40dfd tempest-VolumesActionsTest-1001619042 None] Detach volume completed successfully. Apr 21 20:56:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-127ec46a-3cca-4f1f-abfb-be0fe0f40dfd tempest-VolumesActionsTest-1001619042 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a6acd4b-b463-443e-878f-336d87408544 tempest-VolumesActionsTest-67164883 None] Acquiring lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-detach_volume" by "detach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a6acd4b-b463-443e-878f-336d87408544 tempest-VolumesActionsTest-67164883 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7a6acd4b-b463-443e-878f-336d87408544 tempest-VolumesActionsTest-67164883 None] Volume detach called, but volume not attached. Apr 21 20:56:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a6acd4b-b463-443e-878f-336d87408544 tempest-VolumesActionsTest-67164883 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Acquiring lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Acquiring lock "cinder-quobyte-66c388ab-a56c-470d-9ae7-c70e00dfee86" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Lock "cinder-quobyte-66c388ab-a56c-470d-9ae7-c70e00dfee86" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce63934-a407-4932-8ec0-e174f23d8573]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:06 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 Apr 21 20:56:06 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:07 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86" returned: 0 in 0.775s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:07 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86 Apr 21 20:56:07 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:08 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-66c388ab-a56c-470d-9ae7-c70e00dfee86" returned: 0 in 0.719s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Lock "cinder-quobyte-66c388ab-a56c-470d-9ae7-c70e00dfee86" released by "delete_volume" :: held 1.554s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Created reservations ['aed4c49d-8536-4217-be5b-0aed1a42ea0f', '545d4254-2c9f-4512-beec-8629cc0eb2e8', 'c173257e-09ad-4a0f-95ec-3cf148a37454', '2849d528-2904-4e53-9dcd-8d7d9be4cb82'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:08 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:08 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.843s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:09 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Deleted volume successfully. Apr 21 20:56:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10daedb8-2e7f-45f5-b77b-6a95b0505b5f tempest-VolumesActionsTest-67164883 None] Lock "cinder-66c388ab-a56c-470d-9ae7-c70e00dfee86-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:09 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Flow 'volume_create_manager' (d5e1877f-5828-4e28-8138-cfb04dd390a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40494d38-5cf8-40b8-a3cc-b86f925f7bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40494d38-5cf8-40b8-a3cc-b86f925f7bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-331798817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db0a10d-188c-43c7-85b1-a135d049d55c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1057747c014ea7b055c91122d87024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:10Z,use_quota=True,user_id='312bc93d34364608a04e1f641e04e85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98966546-7e93-48e0-b446-45668b55fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98966546-7e93-48e0-b446-45668b55fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd95c6-43b0-41cb-92b5-a3f76b4b9c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd95c6-43b0-41cb-92b5-a3f76b4b9c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db0a10d-188c-43c7-85b1-a135d049d55c', 'volume_name': 'volume-3db0a10d-188c-43c7-85b1-a135d049d55c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf312fa-5edf-4abf-87ac-9238c0108d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf312fa-5edf-4abf-87ac-9238c0108d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09d74a0-5a62-4f53-a28a-8b2f24d84fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Volume 3db0a10d-188c-43c7-85b1-a135d049d55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db0a10d-188c-43c7-85b1-a135d049d55c', 'volume_size': 1} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-331798817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db0a10d-188c-43c7-85b1-a135d049d55c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1057747c014ea7b055c91122d87024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:10Z,use_quota=True,user_id='312bc93d34364608a04e1f641e04e85f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Creating volume 3db0a10d-188c-43c7-85b1-a135d049d55c {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:10 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c 1073741824 Apr 21 20:56:10 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c 1073741824" returned: 0 in 0.735s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c Apr 21 20:56:10 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c" returned: 0 in 0.485s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09d74a0-5a62-4f53-a28a-8b2f24d84fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db0a10d-188c-43c7-85b1-a135d049d55c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa3c4fa-08db-4f25-90e1-9a14dd6c8c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:11 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Volume volume-3db0a10d-188c-43c7-85b1-a135d049d55c (3db0a10d-188c-43c7-85b1-a135d049d55c): created successfully Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa3c4fa-08db-4f25-90e1-9a14dd6c8c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Flow 'volume_create_manager' (d5e1877f-5828-4e28-8138-cfb04dd390a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:11 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-231b55e3-823d-4560-aed7-974ed84ac5e1 req-53444a84-659b-484b-80b4-4e4ebcf285c1 tempest-VolumesGetTestJSON-1698603397 None] Created volume successfully. Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Flow 'volume_create_manager' (fd9992f2-fe7a-4066-a4f1-a7f81baef585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9caf1a-da57-4d8c-9ed2-fafc80b4d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9caf1a-da57-4d8c-9ed2-fafc80b4d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1744447022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb91a743-f2b5-4b01-8adc-2e79ffe0eb33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7007a63532a7476c9a742cf959aaf260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:12Z,use_quota=True,user_id='3bfe3d99761142cfa2d265308f8afb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399c1f22-a411-48fb-b83d-dbb18d60cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399c1f22-a411-48fb-b83d-dbb18d60cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff6e1bf-cd89-445b-8e11-8be937ffba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff6e1bf-cd89-445b-8e11-8be937ffba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb91a743-f2b5-4b01-8adc-2e79ffe0eb33', 'volume_name': 'volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0212d699-401d-4407-82f9-0a47954ca4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0212d699-401d-4407-82f9-0a47954ca4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fcfd8b-b2c6-4b4e-bb2b-c2a627d46728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Volume bb91a743-f2b5-4b01-8adc-2e79ffe0eb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33', 'volume_size': 1} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1744447022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb91a743-f2b5-4b01-8adc-2e79ffe0eb33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7007a63532a7476c9a742cf959aaf260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:12Z,use_quota=True,user_id='3bfe3d99761142cfa2d265308f8afb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Creating volume bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:12 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 1073741824 Apr 21 20:56:12 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Acquiring lock "cinder-3db0a10d-188c-43c7-85b1-a135d049d55c-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Lock "cinder-3db0a10d-188c-43c7-85b1-a135d049d55c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Acquiring lock "cinder-quobyte-3db0a10d-188c-43c7-85b1-a135d049d55c" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Lock "cinder-quobyte-3db0a10d-188c-43c7-85b1-a135d049d55c" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9cd7d-6d13-40ea-b0a8-8f8e553748f2]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c Apr 21 20:56:12 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 1073741824" returned: 0 in 0.625s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 Apr 21 20:56:12 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c" returned: 0 in 0.563s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c Apr 21 20:56:13 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33" returned: 0 in 0.480s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fcfd8b-b2c6-4b4e-bb2b-c2a627d46728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc357c8-723f-4862-bc20-262339925085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Volume volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 (bb91a743-f2b5-4b01-8adc-2e79ffe0eb33): created successfully Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc357c8-723f-4862-bc20-262339925085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Flow 'volume_create_manager' (fd9992f2-fe7a-4066-a4f1-a7f81baef585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:13 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-78f15cd7-a1a0-4862-b8c2-2b59fff995fa tempest-VolumesTestJSON-1617672291 None] Created volume successfully. Apr 21 20:56:13 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3db0a10d-188c-43c7-85b1-a135d049d55c" returned: 0 in 0.460s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Lock "cinder-quobyte-3db0a10d-188c-43c7-85b1-a135d049d55c" released by "delete_volume" :: held 1.048s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.quota [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Created reservations ['f5022166-65a1-4ff8-a06b-c1047fe3986e', '8f0dd8a5-a271-4d88-be2e-b1ab6cdd49e1', '81af9553-0557-48ea-9ea8-2bffa71356a4', '848f2e2d-cab3-47d3-8fd4-1fd829ffdfef'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:13 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:14 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.manager [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:14 devstack cinder-volume[82005]: INFO cinder.volume.manager [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Deleted volume successfully. Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [req-10280d55-edb6-4404-86d9-1092db04f8b0 req-88877f6d-05a3-4c18-8b75-12dd433d47cf tempest-VolumesGetTestJSON-1698603397 None] Lock "cinder-3db0a10d-188c-43c7-85b1-a135d049d55c-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Flow 'volume_create_manager' (1ce271e1-1d90-46bf-bcce-997629c250c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208674c0-f0ce-4495-b17b-520f744a2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208674c0-f0ce-4495-b17b-520f744a2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-673487990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d898c818-a2e8-4c60-8d31-d6376aa29b02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7007a63532a7476c9a742cf959aaf260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:14Z,use_quota=True,user_id='3bfe3d99761142cfa2d265308f8afb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decf617e-4028-4402-832c-bd7f92ca0fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decf617e-4028-4402-832c-bd7f92ca0fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90f5727-86cc-4895-b07e-7505727292d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90f5727-86cc-4895-b07e-7505727292d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd898c818-a2e8-4c60-8d31-d6376aa29b02', 'volume_name': 'volume-d898c818-a2e8-4c60-8d31-d6376aa29b02', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d859bbad-1922-44ba-90b5-73c959ff1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d859bbad-1922-44ba-90b5-73c959ff1eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c80394e-263d-487e-8ea0-e6a42ff29fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Volume d898c818-a2e8-4c60-8d31-d6376aa29b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d898c818-a2e8-4c60-8d31-d6376aa29b02', 'volume_size': 1} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-673487990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d898c818-a2e8-4c60-8d31-d6376aa29b02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7007a63532a7476c9a742cf959aaf260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:14Z,use_quota=True,user_id='3bfe3d99761142cfa2d265308f8afb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Creating volume d898c818-a2e8-4c60-8d31-d6376aa29b02 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:14 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:14 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 1073741824 Apr 21 20:56:14 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 1073741824" returned: 0 in 0.598s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 Apr 21 20:56:15 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (73b724a1-0894-4ebd-ab48-b792673310ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fc2215-aca1-4c6c-9588-18fe40ac4f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fc2215-aca1-4c6c-9588-18fe40ac4f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1552065952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:15Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ff529-0328-4650-bab9-256f4c5cf098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ff529-0328-4650-bab9-256f4c5cf098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cfcb30-9d1e-4153-9f25-4ec9e5c9d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cfcb30-9d1e-4153-9f25-4ec9e5c9d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4', 'volume_name': 'volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c7ece1-39b3-4c4f-90ab-d6cc1b8fced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c7ece1-39b3-4c4f-90ab-d6cc1b8fced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95e9f82-8b42-42c4-afa0-de393d78c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:15 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Volume 5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4', 'volume_size': 1} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:15 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.092s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1552065952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:15Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Creating volume 5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:15 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c80394e-263d-487e-8ea0-e6a42ff29fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d898c818-a2e8-4c60-8d31-d6376aa29b02', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6469e23-bba5-4b05-8d38-d656030039de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:15 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 1073741824 Apr 21 20:56:15 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Volume volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 (d898c818-a2e8-4c60-8d31-d6376aa29b02): created successfully Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6469e23-bba5-4b05-8d38-d656030039de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Flow 'volume_create_manager' (1ce271e1-1d90-46bf-bcce-997629c250c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:15 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-394dc5c7-94a5-4126-9e8e-f950a8c2c7c8 tempest-VolumesTestJSON-1617672291 None] Created volume successfully. Apr 21 20:56:16 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 1073741824" returned: 0 in 0.663s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 Apr 21 20:56:16 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4" returned: 0 in 0.578s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95e9f82-8b42-42c4-afa0-de393d78c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8c6701-3a70-47b3-9af3-3da7eda34e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Volume volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 (5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4): created successfully Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8c6701-3a70-47b3-9af3-3da7eda34e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (73b724a1-0894-4ebd-ab48-b792673310ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Flow 'volume_create_manager' (6da93cf9-10f3-430d-95e3-264201d75149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1507635a-0071-40fd-b624-dcf85a81b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-42ccc8e6-bb36-4669-8a23-d3b657fca836 tempest-VolumesActionsTest-67164883 None] Created volume successfully. Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1507635a-0071-40fd-b624-dcf85a81b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555654007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7dc76c-2ab2-4374-9986-26c15c908c36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7007a63532a7476c9a742cf959aaf260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:17Z,use_quota=True,user_id='3bfe3d99761142cfa2d265308f8afb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a0cc01-3f56-47c0-9509-5d9224b749d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a0cc01-3f56-47c0-9509-5d9224b749d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e6c442-52ab-436b-977d-8b34c7de75a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e6c442-52ab-436b-977d-8b34c7de75a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7dc76c-2ab2-4374-9986-26c15c908c36', 'volume_name': 'volume-fb7dc76c-2ab2-4374-9986-26c15c908c36', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8750fd-42fe-43a9-8e02-c4cdfecc8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8750fd-42fe-43a9-8e02-c4cdfecc8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788ce153-ce67-4fa2-b70f-44bd900de7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Volume fb7dc76c-2ab2-4374-9986-26c15c908c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7dc76c-2ab2-4374-9986-26c15c908c36', 'volume_size': 1} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555654007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7dc76c-2ab2-4374-9986-26c15c908c36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7007a63532a7476c9a742cf959aaf260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:17Z,use_quota=True,user_id='3bfe3d99761142cfa2d265308f8afb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Creating volume fb7dc76c-2ab2-4374-9986-26c15c908c36 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:16 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 1073741824 Apr 21 20:56:17 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 1073741824" returned: 0 in 0.585s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 Apr 21 20:56:17 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c6b1f84e-2328-40e0-9675-4a4484d20f3b tempest-GroupSnapshotsTest-1426332708 None] Group tempest-GroupSnapshotsTest-Group-367212249: creating Apr 21 20:56:17 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c6b1f84e-2328-40e0-9675-4a4484d20f3b tempest-GroupSnapshotsTest-1426332708 None] Group tempest-GroupSnapshotsTest-Group-367212249: created successfully Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:17 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c6b1f84e-2328-40e0-9675-4a4484d20f3b tempest-GroupSnapshotsTest-1426332708 None] Create group completed successfully. Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-quobyte-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0beacfe-54e0-44e2-b1ba-4ac6a013b291]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 Apr 21 20:56:17 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788ce153-ce67-4fa2-b70f-44bd900de7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7dc76c-2ab2-4374-9986-26c15c908c36', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006f10d3-ba57-4569-84a6-7a8f1cbbd2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Volume volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 (fb7dc76c-2ab2-4374-9986-26c15c908c36): created successfully Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006f10d3-ba57-4569-84a6-7a8f1cbbd2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Flow 'volume_create_manager' (6da93cf9-10f3-430d-95e3-264201d75149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:18 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-73d854f6-57f0-44e5-9b63-25d5c0df65d9 tempest-VolumesTestJSON-1617672291 None] Created volume successfully. Apr 21 20:56:18 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4 Apr 21 20:56:18 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Flow 'volume_create_manager' (c655e5ac-86d6-46bb-b332-489f505b8e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1475e895-b537-4f91-a37a-2b30ce76af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1475e895-b537-4f91-a37a-2b30ce76af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1409816083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff537845-9a32-4f9d-8e9c-1f3232186e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed320fdd3dcf4d4b96bd92b2c53d432e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:18Z,use_quota=True,user_id='7bdae099d3c3442795cb2195e479dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96eab594-dcbe-4712-953e-2ad19c7d0583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96eab594-dcbe-4712-953e-2ad19c7d0583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f32b472-507b-45f4-a8a0-78da2bfe34e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f32b472-507b-45f4-a8a0-78da2bfe34e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff537845-9a32-4f9d-8e9c-1f3232186e1a', 'volume_name': 'volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2bf6ed-b4a2-440d-8782-4d7e08b5ba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2bf6ed-b4a2-440d-8782-4d7e08b5ba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a8151c-909e-41ba-8c28-ec3696344820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Volume ff537845-9a32-4f9d-8e9c-1f3232186e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a', 'volume_size': 1} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1409816083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff537845-9a32-4f9d-8e9c-1f3232186e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed320fdd3dcf4d4b96bd92b2c53d432e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:18Z,use_quota=True,user_id='7bdae099d3c3442795cb2195e479dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Creating volume ff537845-9a32-4f9d-8e9c-1f3232186e1a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:18 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a 1073741824 Apr 21 20:56:18 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4" returned: 0 in 0.417s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4" released by "delete_volume" :: held 0.949s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Created reservations ['e5450302-57b0-479f-8876-dc65b11994c0', '9e99f541-b7a6-420e-a2ef-8a30e18b7ee9', '330ffd23-135e-41ba-8b70-daaccb3f9b20', '27f52dd6-336e-4de4-bf27-e314368c65eb'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:18 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a 1073741824" returned: 0 in 0.540s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a Apr 21 20:56:18 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (95b69006-feb1-4db6-a6a2-08fc46af7556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e500475b-e983-438a-904a-be8c58e8091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e500475b-e983-438a-904a-be8c58e8091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125463980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=296d017a-bc61-4650-b5a0-6bb4deda9966,host='devstack@QuobyteHD#QuobyteHD',id=4b15d33f-d0c8-47f5-8ecb-eb76362a1924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:19Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(419c8395-af64-485e-a9f3-c71dfb152462),volume_type_id=419c8395-af64-485e-a9f3-c71dfb152462)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083cbfc3-cc2a-462f-ad88-f538fd35e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083cbfc3-cc2a-462f-ad88-f538fd35e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6a1b14-0dc7-4b3c-a672-74d54fccbf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6a1b14-0dc7-4b3c-a672-74d54fccbf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b15d33f-d0c8-47f5-8ecb-eb76362a1924', 'volume_name': 'volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5243b6e-7626-4805-9187-f5901baa7fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5243b6e-7626-4805-9187-f5901baa7fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19022ef9-6864-49a7-877c-335df970d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Volume 4b15d33f-d0c8-47f5-8ecb-eb76362a1924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924', 'volume_size': 1} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (53e8022e-b187-46d2-999e-1bea06a934f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8895c309-77bf-4c3a-b6c8-cd207be23742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8895c309-77bf-4c3a-b6c8-cd207be23742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1512224844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a123389-3146-4c05-94c4-94ba34b3c654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:19Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33de5117-e0e5-4032-9127-76c160278586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33de5117-e0e5-4032-9127-76c160278586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5d04db-d517-4639-94af-da1af67f9c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5d04db-d517-4639-94af-da1af67f9c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a123389-3146-4c05-94c4-94ba34b3c654', 'volume_name': 'volume-6a123389-3146-4c05-94c4-94ba34b3c654', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14533be-1b8d-46e0-bed3-0abff5e36c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14533be-1b8d-46e0-bed3-0abff5e36c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a62c0ff-3cb6-4324-82e6-c78705b9ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Volume 6a123389-3146-4c05-94c4-94ba34b3c654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a123389-3146-4c05-94c4-94ba34b3c654', 'volume_size': 1} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.538s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:19 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Deleted volume successfully. Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd6c80de-675c-434e-b32a-95d257b73838 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-5a22a5bc-7ffa-4c6d-9b4c-60133b8431b4-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:19 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a" returned: 0 in 0.517s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=296d017a-bc61-4650-b5a0-6bb4deda9966,created_at=2026-04-21T18:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1125463980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=296d017a-bc61-4650-b5a0-6bb4deda9966,host='devstack@QuobyteHD#QuobyteHD',id=4b15d33f-d0c8-47f5-8ecb-eb76362a1924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:19Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(419c8395-af64-485e-a9f3-c71dfb152462),volume_type_id=419c8395-af64-485e-a9f3-c71dfb152462)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Creating volume 4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:19 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a8151c-909e-41ba-8c28-ec3696344820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 1073741824 Apr 21 20:56:19 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249beb99-90f7-4d70-b8c8-28b3e7de5659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Volume volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a (ff537845-9a32-4f9d-8e9c-1f3232186e1a): created successfully Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249beb99-90f7-4d70-b8c8-28b3e7de5659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Flow 'volume_create_manager' (c655e5ac-86d6-46bb-b332-489f505b8e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:19 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7cd487ee-0f24-4a1a-ad96-458de93698b5 tempest-VolumesListAdminTestJSON-1737947638 None] Created volume successfully. Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "cinder-fb7dc76c-2ab2-4374-9986-26c15c908c36-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-fb7dc76c-2ab2-4374-9986-26c15c908c36-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "cinder-quobyte-fb7dc76c-2ab2-4374-9986-26c15c908c36" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-quobyte-fb7dc76c-2ab2-4374-9986-26c15c908c36" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff058a47-02c1-42f7-8f64-cb50a6f2821e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 Apr 21 20:56:19 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 1073741824" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:19 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36" returned: 0 in 0.491s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36 Apr 21 20:56:20 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.432s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1512224844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a123389-3146-4c05-94c4-94ba34b3c654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:19Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Creating volume 6a123389-3146-4c05-94c4-94ba34b3c654 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:20 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19022ef9-6864-49a7-877c-335df970d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97340229-f8b3-45c6-8236-4f7160b62fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Volume volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 (4b15d33f-d0c8-47f5-8ecb-eb76362a1924): created successfully Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97340229-f8b3-45c6-8236-4f7160b62fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (95b69006-feb1-4db6-a6a2-08fc46af7556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:20 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 1073741824 Apr 21 20:56:20 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-579f1db7-76fc-470e-8630-bab2b6789e4d tempest-GroupSnapshotsTest-1426332708 None] Created volume successfully. Apr 21 20:56:20 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-fb7dc76c-2ab2-4374-9986-26c15c908c36" returned: 0 in 0.443s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Flow 'volume_create_manager' (b8e92d9e-3e1a-4c6d-9929-fbf3f15f6619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdaccca-317d-488a-8aa5-fa3841d7c4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-quobyte-fb7dc76c-2ab2-4374-9986-26c15c908c36" released by "delete_volume" :: held 0.978s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdaccca-317d-488a-8aa5-fa3841d7c4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-205096478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed320fdd3dcf4d4b96bd92b2c53d432e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:21Z,use_quota=True,user_id='7bdae099d3c3442795cb2195e479dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d7dac1-456c-41a2-9d23-92552625e22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d7dac1-456c-41a2-9d23-92552625e22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4063791-fca0-4ca6-9105-25ac6b50756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4063791-fca0-4ca6-9105-25ac6b50756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1', 'volume_name': 'volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105bf2e7-a5f3-413d-b25b-1ab0df0306a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105bf2e7-a5f3-413d-b25b-1ab0df0306a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8affc0f-9aa0-4272-928b-15c0475e31a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Volume 4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1', 'volume_size': 1} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Created reservations ['496b1905-08e6-4578-8244-997eff0be0b1', 'd6f59414-d5c4-4056-8285-e2682162cebe', '32916e54-5064-4545-ab85-ce9abc51cd6d', '03add939-c835-4bcf-9cc5-f2d268dd56f1'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:20 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 1073741824" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 Apr 21 20:56:21 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:21 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] GroupSnapshot 20e72d45-57c1-4ba9-921f-4a31a43c7cb4: creating. Apr 21 20:56:21 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.475s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:21 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Deleted volume successfully. Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Group snapshot 20e72d45-57c1-4ba9-921f-4a31a43c7cb4: creating. {{(pid=82005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3dd96ae2-2a94-43cf-9471-3dc0839773e4 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-fb7dc76c-2ab2-4374-9986-26c15c908c36-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:21 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-205096478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed320fdd3dcf4d4b96bd92b2c53d432e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:21Z,use_quota=True,user_id='7bdae099d3c3442795cb2195e479dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Creating volume 4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:21 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a62c0ff-3cb6-4324-82e6-c78705b9ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a123389-3146-4c05-94c4-94ba34b3c654', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 1073741824 Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83019997-d7e3-40bf-93ab-95080371e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:21 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Volume volume-6a123389-3146-4c05-94c4-94ba34b3c654 (6a123389-3146-4c05-94c4-94ba34b3c654): created successfully Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83019997-d7e3-40bf-93ab-95080371e53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (53e8022e-b187-46d2-999e-1bea06a934f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:21 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-90f7ef8f-1ab0-48fd-9bab-5e01a20cdb24 tempest-VolumesActionsTest-67164883 None] Created volume successfully. Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "cinder-d898c818-a2e8-4c60-8d31-d6376aa29b02-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-d898c818-a2e8-4c60-8d31-d6376aa29b02-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "cinder-quobyte-d898c818-a2e8-4c60-8d31-d6376aa29b02" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-quobyte-d898c818-a2e8-4c60-8d31-d6376aa29b02" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b92cd-dc28-454f-952d-22af1389068a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 1073741824" returned: 0 in 0.497s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 Apr 21 20:56:21 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 Apr 21 20:56:22 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-6a123389-3146-4c05-94c4-94ba34b3c654-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-6a123389-3146-4c05-94c4-94ba34b3c654-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-quobyte-6a123389-3146-4c05-94c4-94ba34b3c654" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-6a123389-3146-4c05-94c4-94ba34b3c654" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:22 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1" returned: 0 in 0.477s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a57f80-6e66-49b8-a0b1-6dec54e08e9a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.097s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02" returned: 0 in 0.534s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8affc0f-9aa0-4272-928b-15c0475e31a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d118c6cf-37a6-4803-b95f-9e0804bb9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Creating offline snapshot 8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 of volume 4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:22 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02 Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7afd39-6425-4b1d-9a93-fc2aecce9871]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:22 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Volume volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 (4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1): created successfully Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d118c6cf-37a6-4803-b95f-9e0804bb9149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 Apr 21 20:56:22 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Flow 'volume_create_manager' (b8e92d9e-3e1a-4c6d-9929-fbf3f15f6619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:22 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-533c578e-f8da-490b-b62d-0a259c2487f7 tempest-VolumesListAdminTestJSON-1737947638 None] Created volume successfully. Apr 21 20:56:22 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:22 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d898c818-a2e8-4c60-8d31-d6376aa29b02" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-quobyte-d898c818-a2e8-4c60-8d31-d6376aa29b02" released by "delete_volume" :: held 1.004s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:22 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Created reservations ['73f1fdb6-1842-42b8-a0b3-4e960c260621', 'f9e9bfb5-9951-4d81-befb-2f7bb6a74d64', '467ed8a8-6e2e-448a-8b9b-ff2d8d6917ad', '60fecb19-3448-4902-a3ed-16c1716c48ec'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:23 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654" returned: 0 in 0.560s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.528s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654 Apr 21 20:56:23 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 1G Apr 21 20:56:23 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:23 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Flow 'volume_create_manager' (f404ce7e-c389-42c8-88ad-e9f8aa0a97a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6194d512-589a-48aa-b1ca-cbc1a3d28113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6194d512-589a-48aa-b1ca-cbc1a3d28113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1324150895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3222ea4f-7942-4401-8d3b-04dacb0f3222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed320fdd3dcf4d4b96bd92b2c53d432e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:23Z,use_quota=True,user_id='7bdae099d3c3442795cb2195e479dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e73925-22b4-4753-a0de-73c180d8ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e73925-22b4-4753-a0de-73c180d8ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e25a1e-b382-4349-b319-e67faecfd89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e25a1e-b382-4349-b319-e67faecfd89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3222ea4f-7942-4401-8d3b-04dacb0f3222', 'volume_name': 'volume-3222ea4f-7942-4401-8d3b-04dacb0f3222', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1e4f10-b6a6-46a3-b528-c4617024dc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1e4f10-b6a6-46a3-b528-c4617024dc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c72e5d-da9a-45f5-a86a-64f992c79393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:23 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Volume 3222ea4f-7942-4401-8d3b-04dacb0f3222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3222ea4f-7942-4401-8d3b-04dacb0f3222', 'volume_size': 1} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:23 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a123389-3146-4c05-94c4-94ba34b3c654" returned: 0 in 0.487s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-6a123389-3146-4c05-94c4-94ba34b3c654" released by "delete_volume" :: held 1.082s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Created reservations ['461e674f-ef50-49fb-837e-9a484f69fa9e', '7e442cdd-4f1a-4a62-9833-2a2909facfbe', 'a74a0392-e367-4865-afe2-d399272369e2', 'f76c5aa1-1d8f-4a50-9ce8-80de227b40bc'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:23 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:23 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Deleted volume successfully. Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a520ac9f-a430-4ae2-8d9f-ab3020662a43 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-d898c818-a2e8-4c60-8d31-d6376aa29b02-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:23 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 1G" returned: 0 in 0.566s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 Apr 21 20:56:23 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:23 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.437s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:24 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Deleted volume successfully. Apr 21 20:56:24 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbaae057-0ed4-46a2-b627-32567268aaca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-6a123389-3146-4c05-94c4-94ba34b3c654-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "cinder-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:24 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 Apr 21 20:56:24 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "cinder-quobyte-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-quobyte-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e56b476-f61b-4f75-952a-2a4fde6cf3ae]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 Apr 21 20:56:24 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" returned: 0 in 0.426s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info Apr 21 20:56:24 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33" returned: 0 in 0.487s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33 Apr 21 20:56:24 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (40565b87-a197-4442-b711-e9211520e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4c2335-a250-4d36-a5ad-9b1b60306c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4c2335-a250-4d36-a5ad-9b1b60306c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341942056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7bbe75-ac0b-444c-a696-3e84c658b6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:25Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe90914-3385-4647-bd65-3cfd46a93f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe90914-3385-4647-bd65-3cfd46a93f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d00b0d5-2fab-4dd2-9798-e3dc53e42f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d00b0d5-2fab-4dd2-9798-e3dc53e42f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7bbe75-ac0b-444c-a696-3e84c658b6db', 'volume_name': 'volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b2e7f8-cffb-454f-8e96-ee00ebbef1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b2e7f8-cffb-454f-8e96-ee00ebbef1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002f810d-9b70-47b4-870b-71644d777477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Volume 7d7bbe75-ac0b-444c-a696-3e84c658b6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db', 'volume_size': 1} Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:24 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info" returned: 0 in 0.427s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info Apr 21 20:56:24 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-quobyte-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33" released by "delete_volume" :: held 0.966s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Created reservations ['3fe53e26-257e-4c34-b89e-94f010865f54', 'c538900e-5064-40a0-a3e8-edc891c078b7', '86815fcb-e812-4c5a-96f8-fbaaf1198367', '8b04b94b-c093-4dfa-ac18-b76c3af0b39a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:25 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.info" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.943s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1324150895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3222ea4f-7942-4401-8d3b-04dacb0f3222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed320fdd3dcf4d4b96bd92b2c53d432e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:23Z,use_quota=True,user_id='7bdae099d3c3442795cb2195e479dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Creating volume 3222ea4f-7942-4401-8d3b-04dacb0f3222 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:25 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 1073741824 Apr 21 20:56:25 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c7090768-4472-447a-9ad9-a3a1c3a1fc76 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 20e72d45-57c1-4ba9-921f-4a31a43c7cb4: created successfully Apr 21 20:56:25 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.412s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Deleted volume successfully. Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ad54217f-9c9d-4967-b9d9-dfcd4a583c75 tempest-VolumesTestJSON-1617672291 None] Lock "cinder-bb91a743-f2b5-4b01-8adc-2e79ffe0eb33-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:25 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 1073741824" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 Apr 21 20:56:25 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222" returned: 0 in 0.409s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341942056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7bbe75-ac0b-444c-a696-3e84c658b6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:25Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Creating volume 7d7bbe75-ac0b-444c-a696-3e84c658b6db {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:26 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c72e5d-da9a-45f5-a86a-64f992c79393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3222ea4f-7942-4401-8d3b-04dacb0f3222', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:26 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db 1073741824 Apr 21 20:56:26 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4248fc-5858-4e36-be3f-3f66bf5e7b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:26 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Volume volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 (3222ea4f-7942-4401-8d3b-04dacb0f3222): created successfully Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4248fc-5858-4e36-be3f-3f66bf5e7b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Flow 'volume_create_manager' (f404ce7e-c389-42c8-88ad-e9f8aa0a97a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:26 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8a363c63-2d1f-4cc0-b4ca-929e03344ec6 tempest-VolumesListAdminTestJSON-1737947638 None] Created volume successfully. Apr 21 20:56:26 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db 1073741824" returned: 0 in 0.572s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[86078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db Apr 21 20:56:26 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:27 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.009s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-8927f3ed-7d6f-41fa-aec3-f55fdbbb8184-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-8927f3ed-7d6f-41fa-aec3-f55fdbbb8184-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Creating volume 55b19b73-d366-4fea-b0f3-f4f2a0bebe4a from snapshot 8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002f810d-9b70-47b4-870b-71644d777477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16bdc60-ba47-45e7-a1ac-058040d24ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Volume volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db (7d7bbe75-ac0b-444c-a696-3e84c658b6db): created successfully Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16bdc60-ba47-45e7-a1ac-058040d24ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (40565b87-a197-4442-b711-e9211520e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] snapshot: 8927f3ed-7d6f-41fa-aec3-f55fdbbb8184, volume: 55b19b73-d366-4fea-b0f3-f4f2a0bebe4a, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f50f70fc-5315-46b5-b371-940480097a46 tempest-VolumesActionsTest-67164883 None] Created volume successfully. Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b244e006-b04e-4103-bcc9-d2fb177b335d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:27 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 Apr 21 20:56:27 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Flow 'volume_create_manager' (76652502-7926-449a-a83d-5b03cd7d835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a6ea5e-d6a5-4789-aa21-65b3e1e69010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a6ea5e-d6a5-4789-aa21-65b3e1e69010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a5af07-5510-4699-8c80-122170fb3a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4d5dc50fae45788ebd9c9c7664d8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:28Z,use_quota=True,user_id='d62438a71b1249929539cad7d76cfde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e26e490-025a-4b8b-9d4c-10f9137de0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e26e490-025a-4b8b-9d4c-10f9137de0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d49eb9-957a-4cc4-85c8-7795973b3680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d49eb9-957a-4cc4-85c8-7795973b3680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a5af07-5510-4699-8c80-122170fb3a0b', 'volume_name': 'volume-96a5af07-5510-4699-8c80-122170fb3a0b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0009c1-a66b-420b-858c-7f6ab8285c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0009c1-a66b-420b-858c-7f6ab8285c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fff457-484e-465d-9ca8-57ad54a17b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Volume 96a5af07-5510-4699-8c80-122170fb3a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a5af07-5510-4699-8c80-122170fb3a0b', 'volume_size': 1} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-7d7bbe75-ac0b-444c-a696-3e84c658b6db-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-7d7bbe75-ac0b-444c-a696-3e84c658b6db-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" returned: 0 in 0.602s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:28 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaffbdd3-dcee-46a8-be5f-c66c4b4501b8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-quobyte-7d7bbe75-ac0b-444c-a696-3e84c658b6db" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-7d7bbe75-ac0b-444c-a696-3e84c658b6db" acquired by "delete_volume" :: waited 0.019s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e422f2a-a0b9-4899-bb3c-d19f9422b2e6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:28 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db Apr 21 20:56:28 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db" returned: 0 in 0.477s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db Apr 21 20:56:28 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.538s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:56:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a Apr 21 20:56:28 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7d7bbe75-ac0b-444c-a696-3e84c658b6db" returned: 0 in 0.436s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-7d7bbe75-ac0b-444c-a696-3e84c658b6db" released by "delete_volume" :: held 0.940s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=163,cinder:SELECT=138,cinder:INSERT=49,cinder:DELETE=17 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Created reservations ['3f98282b-6ffd-452d-9938-0cdef8a9134e', '7bb598c5-558a-49e6-9006-b799bbbc54bb', '21881f42-08e6-4b0b-85a1-e17dbabbb9e1', '8c3a55cc-b0ce-4111-8932-a98cd679e800'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4320a9d-9639-4e1f-9948-31d8f8db27ae tempest-BackendsCapabilitiesAdminTestsJSON-1385927176 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82005) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:56:29 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:29 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1ba89e21-4959-419d-b6a5-c8cdc144005b tempest-BackendsCapabilitiesAdminTestsJSON-1385927176 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82005) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:56:30 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.799s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:30 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Deleted volume successfully. Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-13ea6720-b1dd-4147-8205-b25b5c2315a2 tempest-VolumesActionsTest-1001619042 None] Lock "cinder-7d7bbe75-ac0b-444c-a696-3e84c658b6db-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:30 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" returned: 0 in 1.979s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9d0e9-2795-4731-ae80-e799ba5b6822]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:30 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (5cab8dbc-cfa9-4761-a154-9f22da4540de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb05d065-d746-40eb-8edf-97dbe10aeb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb05d065-d746-40eb-8edf-97dbe10aeb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1984045765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b4a867-cde1-4b2b-875f-8bbd65a9e64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:31Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d9e593-b6dc-4419-90dc-ab48fe497f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d9e593-b6dc-4419-90dc-ab48fe497f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbc3795-9d2e-41d7-98b1-ecb9ae6e4631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbc3795-9d2e-41d7-98b1-ecb9ae6e4631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b4a867-cde1-4b2b-875f-8bbd65a9e64a', 'volume_name': 'volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e80a57-a86e-4b48-9844-52f8b823ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e80a57-a86e-4b48-9844-52f8b823ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61cba11-b5d5-4d31-839f-51bf74e0a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:30 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Volume 88b4a867-cde1-4b2b-875f-8bbd65a9e64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a', 'volume_size': 1} Apr 21 20:56:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:31 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.651s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:31 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Converted 1024.00 MB image at 517.13 MB/s Apr 21 20:56:31 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a Apr 21 20:56:31 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" released by "_copy_volume_from_snapshot" :: held 4.251s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-8927f3ed-7d6f-41fa-aec3-f55fdbbb8184-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" released by "_create_volume_from_snapshot" :: held 4.301s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.310s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.729s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a5af07-5510-4699-8c80-122170fb3a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4d5dc50fae45788ebd9c9c7664d8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:28Z,use_quota=True,user_id='d62438a71b1249929539cad7d76cfde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Creating volume 96a5af07-5510-4699-8c80-122170fb3a0b {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:31 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b 1073741824 Apr 21 20:56:31 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d5907ce2-c85a-400a-95e3-134a1004583e tempest-GroupSnapshotsTest-1426332708 None] Create group from source-snapshot-20e72d45-57c1-4ba9-921f-4a31a43c7cb4 completed successfully. Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a144feda-ac5c-43a9-a83a-4821fab9e324]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a Apr 21 20:56:32 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:32 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b 1073741824" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b Apr 21 20:56:32 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:32 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" returned: 0 in 0.507s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a Apr 21 20:56:32 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:32 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1984045765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b4a867-cde1-4b2b-875f-8bbd65a9e64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:31Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Creating volume 88b4a867-cde1-4b2b-875f-8bbd65a9e64a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:32 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fff457-484e-465d-9ca8-57ad54a17b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a5af07-5510-4699-8c80-122170fb3a0b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:32 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a 1073741824 Apr 21 20:56:32 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e48674-e72d-483d-aa6b-8dfb1557b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:32 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Volume volume-96a5af07-5510-4699-8c80-122170fb3a0b (96a5af07-5510-4699-8c80-122170fb3a0b): created successfully Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e48674-e72d-483d-aa6b-8dfb1557b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Flow 'volume_create_manager' (76652502-7926-449a-a83d-5b03cd7d835a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c836076c-0810-439f-b13d-e7193b13650c tempest-VolumesListAdminTestJSON-604762979 None] Created volume successfully. Apr 21 20:56:33 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" returned: 0 in 0.509s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-55b19b73-d366-4fea-b0f3-f4f2a0bebe4a" released by "delete_volume" :: held 1.038s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['36117af8-0c26-464a-bdc0-b983e44ec0f7'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:33 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a 1073741824" returned: 0 in 0.565s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[82005]: WARNING cinder.quota [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-803278182 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-803278182, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:33 devstack cinder-volume[82005]: WARNING cinder.quota [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-803278182 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-803278182, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['f4b4ea75-428c-42b0-82c0-7b91e149dd1c', '7a7c633b-c920-46b3-bb98-44ac49c6021c', '21e013ea-4b5a-4638-8377-4646327eef50', '999148a2-d217-4c87-ae0e-fd8355958c36'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a Apr 21 20:56:33 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Acquiring lock "cinder-96a5af07-5510-4699-8c80-122170fb3a0b-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Lock "cinder-96a5af07-5510-4699-8c80-122170fb3a0b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Acquiring lock "cinder-quobyte-96a5af07-5510-4699-8c80-122170fb3a0b" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Lock "cinder-quobyte-96a5af07-5510-4699-8c80-122170fb3a0b" acquired by "delete_volume" :: waited 0.024s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe639240-18e5-4ddf-baef-c6ec2188240a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "cinder-3222ea4f-7942-4401-8d3b-04dacb0f3222-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-3222ea4f-7942-4401-8d3b-04dacb0f3222-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:33 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "cinder-quobyte-3222ea4f-7942-4401-8d3b-04dacb0f3222" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-quobyte-3222ea4f-7942-4401-8d3b-04dacb0f3222" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef00a5-4978-4197-90e6-43a3a0c5a2c0]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b Apr 21 20:56:33 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 Apr 21 20:56:33 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a" returned: 0 in 0.556s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61cba11-b5d5-4d31-839f-51bf74e0a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b369ce4-e85a-468a-a04e-5c4064db285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:33 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Volume volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a (88b4a867-cde1-4b2b-875f-8bbd65a9e64a): created successfully Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b369ce4-e85a-468a-a04e-5c4064db285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (5cab8dbc-cfa9-4761-a154-9f22da4540de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ed353ca4-290c-483b-8ec8-a7a47ff2a797 tempest-VolumesActionsTest-67164883 None] Created volume successfully. Apr 21 20:56:34 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.516s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fe32d02b-2da9-469e-b725-de8fb466b041 tempest-GroupSnapshotsTest-1426332708 None] Delete group completed successfully. Apr 21 20:56:34 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222" returned: 0 in 0.567s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222 Apr 21 20:56:34 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:34 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b" returned: 0 in 0.749s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b Apr 21 20:56:34 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 20e72d45-57c1-4ba9-921f-4a31a43c7cb4: deleting Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 20e72d45-57c1-4ba9-921f-4a31a43c7cb4: deleting {{(pid=82005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Deleting offline snapshot 8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 of volume 4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] snapshot_file for this snap is: volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9ba5b-fdaa-41b7-ab10-e0f749dfea22]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 Apr 21 20:56:34 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:34 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3222ea4f-7942-4401-8d3b-04dacb0f3222" returned: 0 in 0.498s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-quobyte-3222ea4f-7942-4401-8d3b-04dacb0f3222" released by "delete_volume" :: held 1.083s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Created reservations ['2322429d-ec11-4251-98b8-7d8355b87a84', '22978018-754d-4f4c-91a7-c8f80d4315ef', 'c157d463-36e9-4592-8268-ae7e68f253d6', 'b0d715f6-c31e-43ea-8975-381bd53390a0'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:34 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:34 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-96a5af07-5510-4699-8c80-122170fb3a0b" returned: 0 in 0.577s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Lock "cinder-quobyte-96a5af07-5510-4699-8c80-122170fb3a0b" released by "delete_volume" :: held 1.353s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Created reservations ['70d884df-9d1c-495f-8a52-68fd063648a2', 'dd678367-db12-4540-a7fb-74c0f3b20a9a', '376b0490-3948-4b9f-8f0d-4d7d8133c797', '30bbb1f7-2f9a-4b14-b11c-3200aca6196b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:34 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-88b4a867-cde1-4b2b-875f-8bbd65a9e64a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-88b4a867-cde1-4b2b-875f-8bbd65a9e64a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:35 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" returned: 0 in 0.711s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Acquiring lock "cinder-quobyte-88b4a867-cde1-4b2b-875f-8bbd65a9e64a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c289717a-aeb8-4d2f-882f-fcc6674c2c76]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-88b4a867-cde1-4b2b-875f-8bbd65a9e64a" acquired by "delete_volume" :: waited 0.025s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.546s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[516c50c7-ca16-4296-977d-cc7be65ea476]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Deleted volume successfully. Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b8680a8-2dbb-4463-9610-51e34faefdaa tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-3222ea4f-7942-4401-8d3b-04dacb0f3222-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:35 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:35 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a Apr 21 20:56:35 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.583s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:35 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Deleted volume successfully. Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-895bf207-b36a-45b5-bc28-e2742eac29cc tempest-VolumesListAdminTestJSON-604762979 None] Lock "cinder-96a5af07-5510-4699-8c80-122170fb3a0b-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "cinder-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "cinder-quobyte-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-quobyte-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e81b87-628e-48bd-8d76-8ade156ec70c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.622s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 Apr 21 20:56:35 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a" returned: 0 in 0.629s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a Apr 21 20:56:36 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 Apr 21 20:56:36 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:36 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1" returned: 0 in 0.522s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1 Apr 21 20:56:36 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-88b4a867-cde1-4b2b-875f-8bbd65a9e64a" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-quobyte-88b4a867-cde1-4b2b-875f-8bbd65a9e64a" released by "delete_volume" :: held 1.179s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:36 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" returned: 0 in 0.596s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Created reservations ['09e6ff95-b2a5-4483-8f15-867dd91a829c', '1dfc4255-543c-4296-9cd1-77616afae1ce', '606beb76-ca46-4c03-89fb-cff599b6f245', '10f09003-362c-4291-a493-ca06ed8d4f42'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:36 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184 Apr 21 20:56:36 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:36 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.577s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:36 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1" returned: 0 in 0.528s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-quobyte-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1" released by "delete_volume" :: held 1.073s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Created reservations ['63142ff9-682e-411c-a66b-ce8d3bcda48b', 'd475c097-ccf1-402d-aa0b-6b30edaca271', 'fb45b336-044d-4b9c-ae3d-765485a6cd0e', '66cec911-2c8f-4097-8cc7-1ba4b4556f3a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924.8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" returned: 0 in 0.562s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:37 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-8927f3ed-7d6f-41fa-aec3-f55fdbbb8184" released by "_delete_snapshot" :: held 2.542s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" released by "delete_snapshot" :: held 2.554s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:37 devstack cinder-volume[82005]: WARNING cinder.quota [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-803278182 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-803278182, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['a99bda5f-ff16-4a55-a7f3-6d892d1088af', '7601a41e-a37a-4093-8e53-e4e734e5e34a', '4dded90a-b4bb-4bb1-9ecc-ef9ed3b8a695', 'b09380d6-8783-4b14-8cf1-05548a6f6f4b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:37 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.604s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-57c8fee8-baa5-4311-85b2-28ac11adcb70 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 20e72d45-57c1-4ba9-921f-4a31a43c7cb4: deleted successfully Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Deleted volume successfully. Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d5881239-89bd-4a2d-a243-2075556245ca tempest-VolumesActionsTest-1001619042 None] Lock "cinder-88b4a867-cde1-4b2b-875f-8bbd65a9e64a-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-300b97d4-d63e-421f-a87c-70ebb64746ca tempest-GroupsTest-1709430079 None] Group tempest-Group1-519569261: creating Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-300b97d4-d63e-421f-a87c-70ebb64746ca tempest-GroupsTest-1709430079 None] Group tempest-Group1-519569261: created successfully Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-300b97d4-d63e-421f-a87c-70ebb64746ca tempest-GroupsTest-1709430079 None] Create group completed successfully. Apr 21 20:56:37 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.444s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Deleted volume successfully. Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f75837d5-2bf8-4120-acd6-e39b1d963604 tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-4eb37e5d-c0cb-43d6-a13f-05cffc87a0b1-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (3b3dbf64-4d65-489f-b58a-9e4bced79a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a9d65e-9a67-4a0f-865e-7dba7f592437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a9d65e-9a67-4a0f-865e-7dba7f592437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1888901035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96596e3-2390-47a0-b6b2-05f41513a041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:38Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88df373-16f1-4baa-a91a-f00928906a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88df373-16f1-4baa-a91a-f00928906a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ad15f9-ca5a-4ca0-a22a-2fa95808668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ad15f9-ca5a-4ca0-a22a-2fa95808668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96596e3-2390-47a0-b6b2-05f41513a041', 'volume_name': 'volume-f96596e3-2390-47a0-b6b2-05f41513a041', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3577c9a-effc-4a44-adaf-8e087a0c29a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3577c9a-effc-4a44-adaf-8e087a0c29a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad637e5-6bbc-4543-a0ee-9a0435dc37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Volume f96596e3-2390-47a0-b6b2-05f41513a041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96596e3-2390-47a0-b6b2-05f41513a041', 'volume_size': 1} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1888901035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96596e3-2390-47a0-b6b2-05f41513a041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f3794e837a41a580b05f9e6a021791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:38Z,use_quota=True,user_id='12c5a9d67b0b4d0c80043e7e4d8a9bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Creating volume f96596e3-2390-47a0-b6b2-05f41513a041 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:37 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 1073741824 Apr 21 20:56:37 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[75471cad-7281-4819-8ac3-b726604626a8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:38 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "cinder-ff537845-9a32-4f9d-8e9c-1f3232186e1a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-ff537845-9a32-4f9d-8e9c-1f3232186e1a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "cinder-quobyte-ff537845-9a32-4f9d-8e9c-1f3232186e1a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-quobyte-ff537845-9a32-4f9d-8e9c-1f3232186e1a" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ba0302-480c-42a8-a143-ba26a614c8d1]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a Apr 21 20:56:38 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 1073741824" returned: 0 in 0.482s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 Apr 21 20:56:38 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7a18ee54-3311-4677-8cb9-008e547846fc tempest-GroupsTest-1709430079 None] Group tempest-Group2-464564368: creating Apr 21 20:56:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7a18ee54-3311-4677-8cb9-008e547846fc tempest-GroupsTest-1709430079 None] Group tempest-Group2-464564368: created successfully Apr 21 20:56:38 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7a18ee54-3311-4677-8cb9-008e547846fc tempest-GroupsTest-1709430079 None] Create group completed successfully. Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.648s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924 Apr 21 20:56:38 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a Apr 21 20:56:38 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad637e5-6bbc-4543-a0ee-9a0435dc37fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96596e3-2390-47a0-b6b2-05f41513a041', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d6309-b904-4f96-8198-5766e20d7239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Volume volume-f96596e3-2390-47a0-b6b2-05f41513a041 (f96596e3-2390-47a0-b6b2-05f41513a041): created successfully Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d6309-b904-4f96-8198-5766e20d7239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Flow 'volume_create_manager' (3b3dbf64-4d65-489f-b58a-9e4bced79a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c68227aa-8599-4d4a-8842-3058fc1a6711 tempest-VolumesActionsTest-67164883 None] Created volume successfully. Apr 21 20:56:38 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-4b15d33f-d0c8-47f5-8ecb-eb76362a1924" released by "delete_volume" :: held 1.087s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['6311777b-497b-473f-a09e-e78d3df2182d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:39 devstack cinder-volume[82005]: WARNING cinder.db.sqlalchemy.api [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-803278182'] Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['54f091eb-3466-42e5-9879-2fa5dc403fbd', '1bf88052-7ed6-49b2-bd92-464677423f3d', '9cdf7aca-8899-48da-a80e-a68d27f74cb1', '8a5755d1-86d9-43d7-a421-490e3f24c089'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:39 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ff537845-9a32-4f9d-8e9c-1f3232186e1a" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-quobyte-ff537845-9a32-4f9d-8e9c-1f3232186e1a" released by "delete_volume" :: held 0.987s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:39 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:39 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Created reservations ['d528ec0d-980d-4d37-a2d6-bc117048d8ec', '27bd94a5-6e52-4b1d-861b-2c2bec279a31', '40cd7b17-f8e7-4ffe-bfd9-cb346f3dd60b', 'fdc11292-7855-4492-8a3e-2a2ca8e702a1'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:39 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:39 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:39 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.394s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:39 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-225795db-cf3d-4438-be1e-4ad26fa40a0d tempest-GroupSnapshotsTest-1426332708 None] Delete group completed successfully. Apr 21 20:56:39 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.417s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:39 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Deleted volume successfully. Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cbfcfa49-ad50-4a94-931c-a4beb269bcbf tempest-VolumesListAdminTestJSON-1737947638 None] Lock "cinder-ff537845-9a32-4f9d-8e9c-1f3232186e1a-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Flow 'volume_create_manager' (ec1dd825-4b04-4337-a2e6-295be61317b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9ea664-0abe-4adc-9083-280867bbc86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9ea664-0abe-4adc-9083-280867bbc86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265071380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e064152b-8124-4f77-8b68-f60d4af49db0,host='devstack@QuobyteHD#QuobyteHD',id=02a47741-5228-4632-8794-05850a4ac35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3f965249bf46f6a2dfb4c3a0ecd6c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:40Z,use_quota=True,user_id='18e0477c354d422984d74ed624ba5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb1f0934-5c27-4e00-afde-54a4084a3dc5),volume_type_id=eb1f0934-5c27-4e00-afde-54a4084a3dc5)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9093f8f-e87d-4867-826c-ed1fae5e150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9093f8f-e87d-4867-826c-ed1fae5e150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112cc67e-24e8-4414-a4fd-57b0821a7b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112cc67e-24e8-4414-a4fd-57b0821a7b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a47741-5228-4632-8794-05850a4ac35e', 'volume_name': 'volume-02a47741-5228-4632-8794-05850a4ac35e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f15931c-13d1-48db-a918-bf1da3ef7450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f15931c-13d1-48db-a918-bf1da3ef7450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca61cb8-05d0-4f0a-961e-4836698ac603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Volume 02a47741-5228-4632-8794-05850a4ac35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a47741-5228-4632-8794-05850a4ac35e', 'volume_size': 1} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e064152b-8124-4f77-8b68-f60d4af49db0,created_at=2026-04-21T18:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265071380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e064152b-8124-4f77-8b68-f60d4af49db0,host='devstack@QuobyteHD#QuobyteHD',id=02a47741-5228-4632-8794-05850a4ac35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3f965249bf46f6a2dfb4c3a0ecd6c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:40Z,use_quota=True,user_id='18e0477c354d422984d74ed624ba5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb1f0934-5c27-4e00-afde-54a4084a3dc5),volume_type_id=eb1f0934-5c27-4e00-afde-54a4084a3dc5)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Creating volume 02a47741-5228-4632-8794-05850a4ac35e {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:39 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:39 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e 1073741824 Apr 21 20:56:39 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Acquiring lock "cinder-f96596e3-2390-47a0-b6b2-05f41513a041-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Lock "cinder-f96596e3-2390-47a0-b6b2-05f41513a041-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Acquiring lock "cinder-quobyte-f96596e3-2390-47a0-b6b2-05f41513a041" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Lock "cinder-quobyte-f96596e3-2390-47a0-b6b2-05f41513a041" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb34a44-ecba-45a4-a151-f0a385ef7177]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5de93c46-5760-456a-ba37-87ce5a9e5a50 tempest-GroupSnapshotsTest-1426332708 None] Group tempest-GroupSnapshotsTest-Group-1634590849: creating Apr 21 20:56:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5de93c46-5760-456a-ba37-87ce5a9e5a50 tempest-GroupSnapshotsTest-1426332708 None] Group tempest-GroupSnapshotsTest-Group-1634590849: created successfully Apr 21 20:56:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5de93c46-5760-456a-ba37-87ce5a9e5a50 tempest-GroupSnapshotsTest-1426332708 None] Create group completed successfully. Apr 21 20:56:40 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 Apr 21 20:56:40 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e 1073741824" returned: 0 in 0.583s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:40 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e Apr 21 20:56:40 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041" returned: 0 in 0.544s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:40 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041 Apr 21 20:56:40 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca61cb8-05d0-4f0a-961e-4836698ac603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a47741-5228-4632-8794-05850a4ac35e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2875d94-d74a-49c7-9d68-fd55c4012605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Volume volume-02a47741-5228-4632-8794-05850a4ac35e (02a47741-5228-4632-8794-05850a4ac35e): created successfully Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2875d94-d74a-49c7-9d68-fd55c4012605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Flow 'volume_create_manager' (ec1dd825-4b04-4337-a2e6-295be61317b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0ab82a4a-f7a5-45b3-8fc8-73e2ac362949 tempest-GroupsTest-1709430079 None] Created volume successfully. Apr 21 20:56:41 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f96596e3-2390-47a0-b6b2-05f41513a041" returned: 0 in 0.497s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Lock "cinder-quobyte-f96596e3-2390-47a0-b6b2-05f41513a041" released by "delete_volume" :: held 1.073s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Created reservations ['aabefcc5-6483-4dc2-a079-52c9393089e0', '9983b083-2db2-49c0-8cfd-e3fba1f97774', '6e944ccb-a09e-47ee-b9ea-4a7aeb38d88b', 'b830b406-3209-4cff-9b6a-84374d74f53b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:41 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (dabb7912-dd85-48b8-8ca0-bab1e4f7916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e89121-6988-40c7-baf8-676c15aaf985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e89121-6988-40c7-baf8-676c15aaf985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-9976153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52b53a20-b518-4d62-83c5-f7952e43d693,host='devstack@QuobyteHD#QuobyteHD',id=15cf70a6-66bb-4fd6-a295-c581b6956a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:42Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5089aeb2-3ee7-4027-b036-8b728d836936),volume_type_id=5089aeb2-3ee7-4027-b036-8b728d836936)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa87e4e1-6ae2-4286-a19f-ac26bfa4dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa87e4e1-6ae2-4286-a19f-ac26bfa4dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd108b8-361c-4e64-b648-2f833aab3deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd108b8-361c-4e64-b648-2f833aab3deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15cf70a6-66bb-4fd6-a295-c581b6956a8d', 'volume_name': 'volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100d5835-3b2e-4442-a5fd-702101a5e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100d5835-3b2e-4442-a5fd-702101a5e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423c94d2-c3e0-4448-9002-4140ea56333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Volume 15cf70a6-66bb-4fd6-a295-c581b6956a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d', 'volume_size': 1} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52b53a20-b518-4d62-83c5-f7952e43d693,created_at=2026-04-21T18:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-9976153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52b53a20-b518-4d62-83c5-f7952e43d693,host='devstack@QuobyteHD#QuobyteHD',id=15cf70a6-66bb-4fd6-a295-c581b6956a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:42Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5089aeb2-3ee7-4027-b036-8b728d836936),volume_type_id=5089aeb2-3ee7-4027-b036-8b728d836936)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Creating volume 15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:41 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d 1073741824 Apr 21 20:56:41 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Deleted volume successfully. Apr 21 20:56:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-319e74f7-e0b7-429e-9473-8875aeef1eab tempest-VolumesActionsTest-67164883 None] Lock "cinder-f96596e3-2390-47a0-b6b2-05f41513a041-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Acquiring lock "cinder-quobyte-02a47741-5228-4632-8794-05850a4ac35e" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:42 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d 1073741824" returned: 0 in 0.620s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Lock "cinder-quobyte-02a47741-5228-4632-8794-05850a4ac35e" acquired by "delete_volume" :: waited 0.026s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a639175f-8aa7-43f6-af7c-e19c7c230304]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d Apr 21 20:56:42 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:42 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e Apr 21 20:56:42 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e" returned: 0 in 0.586s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d" returned: 0 in 0.581s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e Apr 21 20:56:43 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423c94d2-c3e0-4448-9002-4140ea56333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf9f8d5-26ac-4208-b0b7-130e7302cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Volume volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d (15cf70a6-66bb-4fd6-a295-c581b6956a8d): created successfully Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf9f8d5-26ac-4208-b0b7-130e7302cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (dabb7912-dd85-48b8-8ca0-bab1e4f7916e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-37ab9234-d167-4908-b151-ddff2e510a6b tempest-GroupSnapshotsTest-1426332708 None] Created volume successfully. Apr 21 20:56:43 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-02a47741-5228-4632-8794-05850a4ac35e" returned: 0 in 0.467s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Lock "cinder-quobyte-02a47741-5228-4632-8794-05850a4ac35e" released by "delete_volume" :: held 1.081s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Created reservations ['d2777afd-9e22-40f6-ac76-b5a1aad46b32'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:43 devstack cinder-volume[82005]: WARNING cinder.quota [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1397750240 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1397750240, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:43 devstack cinder-volume[82005]: WARNING cinder.quota [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1397750240 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1397750240, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Created reservations ['5003a943-7778-4d7d-9287-6d18ab38cdf7', '66256b2e-5ec8-413c-b8b7-aa0cb2b50cc2', 'b00b298c-6c8d-4cd8-8294-3692c66cee2f', '6015b9c0-a55e-412d-a70f-700afabc904d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:43 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Flow 'volume_create_manager' (dfe2d788-16a7-4dea-b04f-0eba101f8ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622844eb-f4c0-4e72-819e-a911122a08f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622844eb-f4c0-4e72-819e-a911122a08f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-928396603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379ee1a1-cd01-42ba-ba9f-89d054f2227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a8ee6dee92431eb2b7d4376676d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:44Z,use_quota=True,user_id='32c441b9d1f14bc29a84d01ca9ba2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e6a1d0-3631-4abf-97a8-d06982ec88d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e6a1d0-3631-4abf-97a8-d06982ec88d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3839471b-cb8b-4874-b2a3-ec34c06cf753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3839471b-cb8b-4874-b2a3-ec34c06cf753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379ee1a1-cd01-42ba-ba9f-89d054f2227a', 'volume_name': 'volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b21d272-f378-47dc-abb0-678efd64fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b21d272-f378-47dc-abb0-678efd64fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f9dfda-631a-4778-905f-faafec69dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Volume 379ee1a1-cd01-42ba-ba9f-89d054f2227a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a', 'volume_size': 1} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-928396603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379ee1a1-cd01-42ba-ba9f-89d054f2227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a8ee6dee92431eb2b7d4376676d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:44Z,use_quota=True,user_id='32c441b9d1f14bc29a84d01ca9ba2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Creating volume 379ee1a1-cd01-42ba-ba9f-89d054f2227a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:43 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a 1073741824 Apr 21 20:56:43 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.527s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (3054d828-041d-4896-9f76-f0ee940cf172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d985d69-3797-4ccf-b3a7-b4616168c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d985d69-3797-4ccf-b3a7-b4616168c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1176509708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52b53a20-b518-4d62-83c5-f7952e43d693,host='devstack@QuobyteHD#QuobyteHD',id=c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:44Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5089aeb2-3ee7-4027-b036-8b728d836936),volume_type_id=5089aeb2-3ee7-4027-b036-8b728d836936)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0630942-4062-4c36-ac28-7f1adb4eff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0630942-4062-4c36-ac28-7f1adb4eff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21e5afe-6644-481f-925e-506020240be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21e5afe-6644-481f-925e-506020240be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d', 'volume_name': 'volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ace662-87a8-4814-a8c6-42e9ec8b339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ace662-87a8-4814-a8c6-42e9ec8b339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87b4535-7071-4ba7-94b4-20d76cb59a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Volume c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d', 'volume_size': 1} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:44 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0068de87-eca0-409a-957f-48e2e8ba1ee6 tempest-GroupsTest-1709430079 None] Delete group completed successfully. Apr 21 20:56:44 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a 1073741824" returned: 0 in 0.562s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a Apr 21 20:56:44 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Created reservations ['938aaaf7-478b-41ed-89ce-52279daa0976'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:44 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a" returned: 0 in 0.439s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52b53a20-b518-4d62-83c5-f7952e43d693,created_at=2026-04-21T18:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1176509708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52b53a20-b518-4d62-83c5-f7952e43d693,host='devstack@QuobyteHD#QuobyteHD',id=c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:44Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5089aeb2-3ee7-4027-b036-8b728d836936),volume_type_id=5089aeb2-3ee7-4027-b036-8b728d836936)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Creating volume c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:44 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d 1073741824 Apr 21 20:56:44 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f9dfda-631a-4778-905f-faafec69dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d0810f-af0d-4fe3-9b01-6d7b170259f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Volume volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a (379ee1a1-cd01-42ba-ba9f-89d054f2227a): created successfully Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d0810f-af0d-4fe3-9b01-6d7b170259f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Flow 'volume_create_manager' (dfe2d788-16a7-4dea-b04f-0eba101f8ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:44 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-188fd77e-7db5-425e-9554-86a4bc5d3c04 tempest-VolumesTransfersV355Test-169890552 None] Created volume successfully. Apr 21 20:56:45 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e36f86c6-d4f5-43e8-89ba-859f18c3c9fc tempest-GroupsTest-1709430079 None] Delete group completed successfully. Apr 21 20:56:45 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d 1073741824" returned: 0 in 0.506s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d Apr 21 20:56:45 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" returned: 0 in 0.466s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87b4535-7071-4ba7-94b4-20d76cb59a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e3a2f3-9ea2-493f-9abd-cccf45f12ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:45 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Volume volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d (c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d): created successfully Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e3a2f3-9ea2-493f-9abd-cccf45f12ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (3054d828-041d-4896-9f76-f0ee940cf172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a99beb6e-80f1-40ee-8b7a-d369d56746f0 tempest-GroupSnapshotsTest-1426332708 None] Created volume successfully. Apr 21 20:56:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fe769dad-79df-4e73-ab90-986de9105caf tempest-GroupsTest-1709430079 None] Group tempest-GroupsTest-Group-2102048714: creating Apr 21 20:56:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fe769dad-79df-4e73-ab90-986de9105caf tempest-GroupsTest-1709430079 None] Group tempest-GroupsTest-Group-2102048714: created successfully Apr 21 20:56:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fe769dad-79df-4e73-ab90-986de9105caf tempest-GroupsTest-1709430079 None] Create group completed successfully. Apr 21 20:56:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-1d95be37-9d95-4ebc-bf41-8f911101da3c tempest-VolumesTransfersV355Test-1907816494 None] Transfer volume completed successfully. Apr 21 20:56:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c888db8c-6352-4dea-b7db-4ca00f6e9ee1 tempest-GroupSnapshotsTest-1426332708 None] Update group completed successfully. Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Acquiring lock "cinder-379ee1a1-cd01-42ba-ba9f-89d054f2227a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-379ee1a1-cd01-42ba-ba9f-89d054f2227a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Acquiring lock "cinder-quobyte-379ee1a1-cd01-42ba-ba9f-89d054f2227a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-quobyte-379ee1a1-cd01-42ba-ba9f-89d054f2227a" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368de89-5f9a-4ede-a7ad-401691390f02]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a Apr 21 20:56:47 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Flow 'volume_create_manager' (35a7bedf-af43-4a90-b38e-433cd5284cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0faefc7-ffe1-42f0-8ed6-f88c27ef16b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0faefc7-ffe1-42f0-8ed6-f88c27ef16b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258607866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9767a5d-931a-47a0-8de3-91ecb21aae87,host='devstack@QuobyteHD#QuobyteHD',id=6f75778e-beb2-44d8-8ea7-a6cfd38c54c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3f965249bf46f6a2dfb4c3a0ecd6c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:47Z,use_quota=True,user_id='18e0477c354d422984d74ed624ba5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0abd9142-0105-4912-aebd-d01f3193b9d1),volume_type_id=0abd9142-0105-4912-aebd-d01f3193b9d1)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20da10c4-eedd-4cc6-ba7c-30029ad596bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20da10c4-eedd-4cc6-ba7c-30029ad596bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92ab507-49ac-42ed-af62-620af665739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92ab507-49ac-42ed-af62-620af665739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f75778e-beb2-44d8-8ea7-a6cfd38c54c6', 'volume_name': 'volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2eda95-7939-4132-889a-a37e993209d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2eda95-7939-4132-889a-a37e993209d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70c8874-68ce-4f71-bee6-35e10603d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Volume 6f75778e-beb2-44d8-8ea7-a6cfd38c54c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6', 'volume_size': 1} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9767a5d-931a-47a0-8de3-91ecb21aae87,created_at=2026-04-21T18:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258607866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9767a5d-931a-47a0-8de3-91ecb21aae87,host='devstack@QuobyteHD#QuobyteHD',id=6f75778e-beb2-44d8-8ea7-a6cfd38c54c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3f965249bf46f6a2dfb4c3a0ecd6c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:47Z,use_quota=True,user_id='18e0477c354d422984d74ed624ba5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0abd9142-0105-4912-aebd-d01f3193b9d1),volume_type_id=0abd9142-0105-4912-aebd-d01f3193b9d1)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Creating volume 6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:47 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 1073741824 Apr 21 20:56:47 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-78efdbb1-e8f6-47da-861b-3a6fa42d0fdb tempest-GroupSnapshotsTest-1426332708 None] Update group completed successfully. Apr 21 20:56:47 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a" returned: 0 in 0.577s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a Apr 21 20:56:47 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 1073741824" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 Apr 21 20:56:48 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-379ee1a1-cd01-42ba-ba9f-89d054f2227a" returned: 0 in 0.516s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-quobyte-379ee1a1-cd01-42ba-ba9f-89d054f2227a" released by "delete_volume" :: held 1.124s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Created reservations ['470a7cdb-229b-4230-8c91-3fbf0f83c708', '0a78bb49-467d-4831-9e54-46075fdfe0be', '840283be-9658-4322-8a65-de29692668a4', '5538a02c-4b86-4677-bd93-7ae7cfe84ab1'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:48 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6" returned: 0 in 0.562s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70c8874-68ce-4f71-bee6-35e10603d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e452bd99-ba03-4e80-9f9d-bc927ac1c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:48 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Volume volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 (6f75778e-beb2-44d8-8ea7-a6cfd38c54c6): created successfully Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e452bd99-ba03-4e80-9f9d-bc927ac1c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Flow 'volume_create_manager' (35a7bedf-af43-4a90-b38e-433cd5284cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6299b0ef-0271-4255-a355-22fb0f86835f tempest-GroupsTest-1709430079 None] Created volume successfully. Apr 21 20:56:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7d487e3f-8f55-44b5-b42c-ee0929a5e14e tempest-GroupSnapshotsTest-1426332708 None] Update group completed successfully. Apr 21 20:56:48 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.473s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Deleted volume successfully. Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fc1f463c-9a2d-470f-8821-702420009bea tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-379ee1a1-cd01-42ba-ba9f-89d054f2227a-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Flow 'volume_create_manager' (0d130383-bdeb-4951-8951-e0ff9cbdcc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c38d79-27db-4cbe-aef9-b082bdb65ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c38d79-27db-4cbe-aef9-b082bdb65ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-353911700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902e1f6b-87ee-40ad-8621-8f5803eaee73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a8ee6dee92431eb2b7d4376676d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:50Z,use_quota=True,user_id='32c441b9d1f14bc29a84d01ca9ba2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a178efbe-4496-45e8-be87-adcc67e26537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a178efbe-4496-45e8-be87-adcc67e26537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a401109-164d-421c-9bbd-188428aa097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a401109-164d-421c-9bbd-188428aa097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902e1f6b-87ee-40ad-8621-8f5803eaee73', 'volume_name': 'volume-902e1f6b-87ee-40ad-8621-8f5803eaee73', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52ef413-c292-452d-a8ec-086b0209e7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52ef413-c292-452d-a8ec-086b0209e7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ddf8d7-4fd8-4f9c-8f3f-ba008008b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:49 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Volume 902e1f6b-87ee-40ad-8621-8f5803eaee73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902e1f6b-87ee-40ad-8621-8f5803eaee73', 'volume_size': 1} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-353911700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902e1f6b-87ee-40ad-8621-8f5803eaee73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a8ee6dee92431eb2b7d4376676d47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:50Z,use_quota=True,user_id='32c441b9d1f14bc29a84d01ca9ba2426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Creating volume 902e1f6b-87ee-40ad-8621-8f5803eaee73 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:49 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 1073741824 Apr 21 20:56:49 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e701cd58-b846-49f2-8896-3ba3c15a06d8 tempest-GroupSnapshotsTest-1426332708 None] Update group completed successfully. Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Flow 'volume_create_manager' (810d354e-dcaa-4c91-b3cd-ed5aabf267ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becc73b9-78b3-4db8-bbe4-438eec6f640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becc73b9-78b3-4db8-bbe4-438eec6f640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-893877676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9767a5d-931a-47a0-8de3-91ecb21aae87,host='devstack@QuobyteHD#QuobyteHD',id=95aa8462-a97c-436b-8087-b540c8f4c3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3f965249bf46f6a2dfb4c3a0ecd6c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:50Z,use_quota=True,user_id='18e0477c354d422984d74ed624ba5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0abd9142-0105-4912-aebd-d01f3193b9d1),volume_type_id=0abd9142-0105-4912-aebd-d01f3193b9d1)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415318ab-5694-49ee-ad83-1c867647736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415318ab-5694-49ee-ad83-1c867647736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211c0c5d-6ed3-436b-ba31-c6deefdbf946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211c0c5d-6ed3-436b-ba31-c6deefdbf946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95aa8462-a97c-436b-8087-b540c8f4c3f1', 'volume_name': 'volume-95aa8462-a97c-436b-8087-b540c8f4c3f1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6aae02-1f39-4190-bb58-c607c1d3bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6aae02-1f39-4190-bb58-c607c1d3bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aa48cb-6466-4193-90dd-cd2fe07cddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Volume 95aa8462-a97c-436b-8087-b540c8f4c3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95aa8462-a97c-436b-8087-b540c8f4c3f1', 'volume_size': 1} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:50 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 1073741824" returned: 0 in 0.591s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 Apr 21 20:56:50 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b9767a5d-931a-47a0-8de3-91ecb21aae87,created_at=2026-04-21T18:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-893877676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b9767a5d-931a-47a0-8de3-91ecb21aae87,host='devstack@QuobyteHD#QuobyteHD',id=95aa8462-a97c-436b-8087-b540c8f4c3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3f965249bf46f6a2dfb4c3a0ecd6c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:50Z,use_quota=True,user_id='18e0477c354d422984d74ed624ba5e26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0abd9142-0105-4912-aebd-d01f3193b9d1),volume_type_id=0abd9142-0105-4912-aebd-d01f3193b9d1)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Creating volume 95aa8462-a97c-436b-8087-b540c8f4c3f1 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:50 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 1073741824 Apr 21 20:56:50 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ddf8d7-4fd8-4f9c-8f3f-ba008008b18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902e1f6b-87ee-40ad-8621-8f5803eaee73', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8deb8e8-fadc-4fa9-801d-8d802ce49efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Volume volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 (902e1f6b-87ee-40ad-8621-8f5803eaee73): created successfully Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8deb8e8-fadc-4fa9-801d-8d802ce49efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Flow 'volume_create_manager' (0d130383-bdeb-4951-8951-e0ff9cbdcc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:50 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Flow 'volume_create_manager' (c909e541-1a11-4695-81f4-4c65e749f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6206adb9-34e6-4614-9fc2-81600c256649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6206adb9-34e6-4614-9fc2-81600c256649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-796021742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02c90b0-0889-41b4-a141-c65f8fcb06e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e185ac14974a22a987e60987f2cf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:51Z,use_quota=True,user_id='8ad4c2aa38704d8fbd463d9635db043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f95b27b-5096-4557-95ca-c15b07c7d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f95b27b-5096-4557-95ca-c15b07c7d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1100289c-7be1-400f-a46e-fcebc21abc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1100289c-7be1-400f-a46e-fcebc21abc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02c90b0-0889-41b4-a141-c65f8fcb06e4', 'volume_name': 'volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcb6bc4-5713-4d39-8bc4-dc5748eceab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcb6bc4-5713-4d39-8bc4-dc5748eceab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62162902-52cf-4be4-bf1d-a0281d8a2c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Volume a02c90b0-0889-41b4-a141-c65f8fcb06e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4', 'volume_size': 1} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-77abb2c3-5bb8-4d09-92a0-65b0e875e80a tempest-VolumesTransfersV355Test-169890552 None] Created volume successfully. Apr 21 20:56:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] GroupSnapshot 4d9b9741-e0a8-43ff-b8e6-e95aba67c46e: creating. Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Group snapshot 4d9b9741-e0a8-43ff-b8e6-e95aba67c46e: creating. {{(pid=82005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 1073741824" returned: 0 in 0.490s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 Apr 21 20:56:51 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1" returned: 0 in 0.394s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-796021742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02c90b0-0889-41b4-a141-c65f8fcb06e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e185ac14974a22a987e60987f2cf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:51Z,use_quota=True,user_id='8ad4c2aa38704d8fbd463d9635db043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Creating volume a02c90b0-0889-41b4-a141-c65f8fcb06e4 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:51 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aa48cb-6466-4193-90dd-cd2fe07cddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95aa8462-a97c-436b-8087-b540c8f4c3f1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 1073741824 Apr 21 20:56:51 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f1039c-fbbe-4ce5-9892-965e2cd27a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Volume volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 (95aa8462-a97c-436b-8087-b540c8f4c3f1): created successfully Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f1039c-fbbe-4ce5-9892-965e2cd27a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Flow 'volume_create_manager' (810d354e-dcaa-4c91-b3cd-ed5aabf267ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-08eef900-d6ec-49af-ae94-26c501163a52 tempest-GroupsTest-1709430079 None] Created volume successfully. Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Acquiring lock "cinder-902e1f6b-87ee-40ad-8621-8f5803eaee73-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-902e1f6b-87ee-40ad-8621-8f5803eaee73-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Acquiring lock "cinder-quobyte-902e1f6b-87ee-40ad-8621-8f5803eaee73" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-quobyte-902e1f6b-87ee-40ad-8621-8f5803eaee73" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f00ca0-f1ae-4e68-839c-362b0d16fd1f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 Apr 21 20:56:52 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-54928c32-c619-46ea-88e5-3d983cece758 tempest-GroupsTest-1709430079 None] Update group completed successfully. Apr 21 20:56:52 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 1073741824" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 Apr 21 20:56:52 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73 Apr 21 20:56:52 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4" returned: 0 in 0.411s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.558s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62162902-52cf-4be4-bf1d-a0281d8a2c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea50c1a-c77f-4c8c-9e90-1722aa8cf212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Creating offline snapshot 0615746b-e21c-41b9-b215-dc7a52f05b49 of volume c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Volume volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 (a02c90b0-0889-41b4-a141-c65f8fcb06e4): created successfully Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea50c1a-c77f-4c8c-9e90-1722aa8cf212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Flow 'volume_create_manager' (c909e541-1a11-4695-81f4-4c65e749f62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b7228-f3f7-4dc1-a82e-8dacd1e7df8c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-59b09d97-ce85-470d-93a6-90c842cd29d5 tempest-VolumesTransfersV357Test-468509793 None] Created volume successfully. Apr 21 20:56:52 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d Apr 21 20:56:52 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-902e1f6b-87ee-40ad-8621-8f5803eaee73" returned: 0 in 0.452s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-quobyte-902e1f6b-87ee-40ad-8621-8f5803eaee73" released by "delete_volume" :: held 0.979s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Created reservations ['8e64775d-5bcb-464c-bfa1-269112312726', '483fdd84-f7e7-497a-9515-bcc038422ffc', '5245541f-386e-46d1-a9de-2b2fbeae64d9', '2d524a9f-2339-473c-bd3f-1a1522eb1dfa'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:53 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" returned: 0 in 0.587s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3561ffce-324e-4c81-bd3b-4b080eb16995 tempest-VolumesTransfersV357Test-577537755 None] Transfer volume completed successfully. Apr 21 20:56:53 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 1G Apr 21 20:56:53 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-432d96f6-fe95-4732-95fd-385421bdd004 tempest-GroupsTest-1709430079 None] Update group completed successfully. Apr 21 20:56:53 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Deleted volume successfully. Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c58d8e49-3fe3-4bec-8a90-a95939fd2d5f tempest-VolumesTransfersV355Test-929230586 None] Lock "cinder-902e1f6b-87ee-40ad-8621-8f5803eaee73-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 1G" returned: 0 in 0.480s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 Apr 21 20:56:53 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Acquiring lock "cinder-a02c90b0-0889-41b4-a141-c65f8fcb06e4-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-a02c90b0-0889-41b4-a141-c65f8fcb06e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Acquiring lock "cinder-quobyte-a02c90b0-0889-41b4-a141-c65f8fcb06e4" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-quobyte-a02c90b0-0889-41b4-a141-c65f8fcb06e4" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8401d9ca-ead8-4318-a6b8-798f753c5944]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 Apr 21 20:56:54 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 Apr 21 20:56:54 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Acquiring lock "cinder-quobyte-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Lock "cinder-quobyte-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49" returned: 0 in 0.491s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4266093-0fac-4ba0-8ac0-c998acd477f7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4" returned: 0 in 0.616s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4 Apr 21 20:56:54 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info Apr 21 20:56:54 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 Apr 21 20:56:54 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info" returned: 0 in 0.499s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a02c90b0-0889-41b4-a141-c65f8fcb06e4" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info Apr 21 20:56:55 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-quobyte-a02c90b0-0889-41b4-a141-c65f8fcb06e4" released by "delete_volume" :: held 1.196s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Created reservations ['e7ec8d07-4618-4a45-8d03-964f88a7f5e8', '5e32c091-f8e3-4c5f-a068-1764db162155', '7cf23b1c-296c-4773-9e41-6a011b719247', 'c116a5e9-a130-4e5b-8d97-6b21b9fd5ce5'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:55 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6" returned: 0 in 0.650s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6 Apr 21 20:56:55 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:55 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.info" returned: 0 in 0.578s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.222s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Creating offline snapshot 425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb of volume 15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff18b15-96b0-4c17-8fdb-7612c3319cad]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:56 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Deleted volume successfully. Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Lock "cinder-quobyte-6f75778e-beb2-44d8-8ea7-a6cfd38c54c6" released by "delete_volume" :: held 1.242s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Acquiring lock "cinder-quobyte-95aa8462-a97c-436b-8087-b540c8f4c3f1" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:56 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d Apr 21 20:56:56 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53743bf7-e8b3-4559-8f6b-fce4f6067bf9 tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-a02c90b0-0889-41b4-a141-c65f8fcb06e4-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Lock "cinder-quobyte-95aa8462-a97c-436b-8087-b540c8f4c3f1" acquired by "delete_volume" :: waited 0.019s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68d735-2a53-4053-a884-342a98bd834b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 Apr 21 20:56:56 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d" returned: 0 in 0.603s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb 1G Apr 21 20:56:56 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Flow 'volume_create_manager' (aa1590b4-b930-4e4b-8025-535e50d48035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f61741e-0526-44b4-9f35-697576472f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f61741e-0526-44b4-9f35-697576472f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1667892412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0c8778-df9d-4600-a354-5f2d096dd60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e185ac14974a22a987e60987f2cf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:57Z,use_quota=True,user_id='8ad4c2aa38704d8fbd463d9635db043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6ce436-b9cf-493d-8f23-1dc62ef6f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:56 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6ce436-b9cf-493d-8f23-1dc62ef6f608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def99bf4-e012-46eb-8bbb-80887e52b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def99bf4-e012-46eb-8bbb-80887e52b587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0c8778-df9d-4600-a354-5f2d096dd60b', 'volume_name': 'volume-bf0c8778-df9d-4600-a354-5f2d096dd60b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db278115-9899-4dab-a896-aef13b58b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db278115-9899-4dab-a896-aef13b58b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36064860-1263-48a1-9908-fcbca03aefdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Volume bf0c8778-df9d-4600-a354-5f2d096dd60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0c8778-df9d-4600-a354-5f2d096dd60b', 'volume_size': 1} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1" returned: 0 in 0.684s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1 Apr 21 20:56:56 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb 1G" returned: 0 in 0.594s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb Apr 21 20:56:57 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-95aa8462-a97c-436b-8087-b540c8f4c3f1" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Lock "cinder-quobyte-95aa8462-a97c-436b-8087-b540c8f4c3f1" released by "delete_volume" :: held 1.193s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Created reservations ['9864fdcd-04f7-4903-8543-d5146c37754e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:57 devstack cinder-volume[82005]: WARNING cinder.quota [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-275751413 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-275751413, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:57 devstack cinder-volume[82005]: WARNING cinder.quota [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-275751413 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-275751413, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Created reservations ['9fda8636-016d-417b-b268-7705d3173266', 'f6dfe918-b425-4089-ad96-fb883d865d04', 'b018175d-0a74-4af6-b727-d8174022fcb3', '4e30501e-9dbb-4183-9dac-0e7c2025eaca'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Created reservations ['801860b8-c2e0-4336-a949-a49de8064660', '05e4dd3e-a895-4795-8966-564ce8a62ba5', 'a0fdfacf-6052-4aad-b5b2-d94c8e78f228', '9596948c-2960-4487-bd1e-b57e0ce1fc26'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:56:57 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" returned: 0 in 0.502s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb Apr 21 20:56:57 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (03cfb7be-d6c8-41b6-9747-fa79bb3ff1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac024b6a-d154-4a8e-a542-991408a38746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac024b6a-d154-4a8e-a542-991408a38746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2090555262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30376ffe-81b9-49d1-a73c-9c0ee834c82d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:58Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:58 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f59804-9ac0-42b9-872d-82b246c54745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f59804-9ac0-42b9-872d-82b246c54745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c395e88-8452-410b-b701-aaf241a08788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c395e88-8452-410b-b701-aaf241a08788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30376ffe-81b9-49d1-a73c-9c0ee834c82d', 'volume_name': 'volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae63a4f-18f6-457a-9e5d-326ecc7aa424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae63a4f-18f6-457a-9e5d-326ecc7aa424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeced2c5-94c0-419b-8746-13e96fdc08d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Volume 30376ffe-81b9-49d1-a73c-9c0ee834c82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d', 'volume_size': 1} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:58 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5fff5c54-a7d1-43ac-86cd-0167a16f71ea tempest-GroupsTest-1709430079 None] Delete group completed successfully. Apr 21 20:56:58 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info Apr 21 20:56:58 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info" returned: 0 in 0.501s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:56:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info Apr 21 20:56:58 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.info" returned: 0 in 0.460s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.413s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1667892412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0c8778-df9d-4600-a354-5f2d096dd60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e185ac14974a22a987e60987f2cf38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:57Z,use_quota=True,user_id='8ad4c2aa38704d8fbd463d9635db043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Creating volume bf0c8778-df9d-4600-a354-5f2d096dd60b {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:59 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b 1073741824 Apr 21 20:56:59 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-07613be5-0e87-41cb-8fb2-267c3805a57d tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 4d9b9741-e0a8-43ff-b8e6-e95aba67c46e: created successfully Apr 21 20:56:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 4d9b9741-e0a8-43ff-b8e6-e95aba67c46e: deleting Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 4d9b9741-e0a8-43ff-b8e6-e95aba67c46e: deleting {{(pid=82005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-0615746b-e21c-41b9-b215-dc7a52f05b49" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-0615746b-e21c-41b9-b215-dc7a52f05b49" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Deleting offline snapshot 0615746b-e21c-41b9-b215-dc7a52f05b49 of volume c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] snapshot_file for this snap is: volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cff866-1a19-42ca-a4a7-fe2952f2e8b4]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b 1073741824" returned: 0 in 0.628s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 Apr 21 20:56:59 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b Apr 21 20:56:59 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.309s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2090555262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30376ffe-81b9-49d1-a73c-9c0ee834c82d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:58Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Creating volume 30376ffe-81b9-49d1-a73c-9c0ee834c82d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:00 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49" returned: 0 in 0.623s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:00 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d 1073741824 Apr 21 20:57:00 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36064860-1263-48a1-9908-fcbca03aefdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0c8778-df9d-4600-a354-5f2d096dd60b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa75a22-986b-4b64-86ed-e4aff433b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c227e4d7-da88-45b2-adda-c7ab18ea6b6b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Volume volume-bf0c8778-df9d-4600-a354-5f2d096dd60b (bf0c8778-df9d-4600-a354-5f2d096dd60b): created successfully Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa75a22-986b-4b64-86ed-e4aff433b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Flow 'volume_create_manager' (aa1590b4-b930-4e4b-8025-535e50d48035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:00 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-481679a6-f794-4abb-9235-4c028c3c43a4 tempest-VolumesTransfersV357Test-468509793 None] Created volume successfully. Apr 21 20:57:00 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d Apr 21 20:57:00 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d 1073741824" returned: 0 in 0.570s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d Apr 21 20:57:01 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" returned: 0 in 0.591s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 Apr 21 20:57:01 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Acquiring lock "cinder-bf0c8778-df9d-4600-a354-5f2d096dd60b-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-bf0c8778-df9d-4600-a354-5f2d096dd60b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Acquiring lock "cinder-quobyte-bf0c8778-df9d-4600-a354-5f2d096dd60b" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-quobyte-bf0c8778-df9d-4600-a354-5f2d096dd60b" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b9aac-93fe-47f8-91e7-8c49a7000ad6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b Apr 21 20:57:01 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a1ee977d-e6c3-4971-8bb3-2003fa98e941 tempest-GroupsV320Test-1114622087 None] Group tempest-GroupsV320Test-Group-844134270: creating Apr 21 20:57:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a1ee977d-e6c3-4971-8bb3-2003fa98e941 tempest-GroupsV320Test-1114622087 None] Group tempest-GroupsV320Test-Group-844134270: created successfully Apr 21 20:57:01 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d" returned: 0 in 0.591s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a1ee977d-e6c3-4971-8bb3-2003fa98e941 tempest-GroupsV320Test-1114622087 None] Create group completed successfully. Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeced2c5-94c0-419b-8746-13e96fdc08d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01270c9a-ebc2-4fea-975b-a3a68e2b624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Volume volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d (30376ffe-81b9-49d1-a73c-9c0ee834c82d): created successfully Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01270c9a-ebc2-4fea-975b-a3a68e2b624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (03cfb7be-d6c8-41b6-9747-fa79bb3ff1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b3c1b0e2-403a-4504-bce7-9b5c14867daf tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:01 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49" returned: 0 in 0.604s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49 Apr 21 20:57:01 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b" returned: 0 in 0.519s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b Apr 21 20:57:01 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d.0615746b-e21c-41b9-b215-dc7a52f05b49" returned: 0 in 0.399s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-0615746b-e21c-41b9-b215-dc7a52f05b49" released by "_delete_snapshot" :: held 2.290s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" released by "delete_snapshot" :: held 2.302s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-15cf70a6-66bb-4fd6-a295-c581b6956a8d" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-15cf70a6-66bb-4fd6-a295-c581b6956a8d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Deleting offline snapshot 425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb of volume 15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] snapshot_file for this snap is: volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0ab31-c177-40ac-92a6-f010be1db50f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb Apr 21 20:57:02 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bf0c8778-df9d-4600-a354-5f2d096dd60b" returned: 0 in 0.478s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-quobyte-bf0c8778-df9d-4600-a354-5f2d096dd60b" released by "delete_volume" :: held 1.027s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=328,cinder:DELETE=22,cinder:SELECT=258,cinder:INSERT=53 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Created reservations ['5cf82de1-942a-4e49-b2d0-c186fbe0e4ec', '1c469bde-0dd9-4ae9-82de-54601f5cd6ed', '7d823ccd-ae38-4e0c-992b-3ab3f6e68fb5', '1f3dee56-1b0c-4e70-95d9-87980c43e7e9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:02 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" returned: 0 in 0.574s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc27830-add7-49b6-8fb6-22b460a31d53]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (16467f47-8d33-4bd3-9eb3-89d6a2c027df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b76009-6594-430e-951c-c5fd11c8ac45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b76009-6594-430e-951c-c5fd11c8ac45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1585097608',display_name='tempest-VolumesGetTest-Volume-1594247649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7b1426-d5c3-43f1-b4c2-82568ca34f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:03Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a41b35-003b-4506-bfd4-7110686886d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a41b35-003b-4506-bfd4-7110686886d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7419147c-6825-46a5-99ef-aae594ccc733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7419147c-6825-46a5-99ef-aae594ccc733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7b1426-d5c3-43f1-b4c2-82568ca34f16', 'volume_name': 'volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:02 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba3a3c8-165a-4d3e-bcc2-c20eaa70f58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:02 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba3a3c8-165a-4d3e-bcc2-c20eaa70f58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce930dcd-5c43-4c82-90cf-9d50b6eb59f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Volume ed7b1426-d5c3-43f1-b4c2-82568ca34f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16', 'volume_size': 1} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1585097608',display_name='tempest-VolumesGetTest-Volume-1594247649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7b1426-d5c3-43f1-b4c2-82568ca34f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:03Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Creating volume ed7b1426-d5c3-43f1-b4c2-82568ca34f16 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:02 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 1073741824 Apr 21 20:57:02 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.490s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Deleted volume successfully. Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3f7c37e-b1af-465c-8aea-fe24c4f0e24e tempest-VolumesTransfersV357Test-120459916 None] Lock "cinder-bf0c8778-df9d-4600-a354-5f2d096dd60b-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:02 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Created reservations ['c142e4e0-73d2-4129-8840-6f5ba7d69c03'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:03 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d" returned: 0 in 0.530s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb Apr 21 20:57:03 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 1073741824" returned: 0 in 0.549s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 Apr 21 20:57:03 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9bcbc3b4-df4d-4aa6-93ef-07b21f5646b3 tempest-GroupsV320Test-1114622087 None] Delete group completed successfully. Apr 21 20:57:03 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb Apr 21 20:57:03 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16" returned: 0 in 0.466s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce930dcd-5c43-4c82-90cf-9d50b6eb59f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf9c521-b1d1-45b8-84b2-995376298d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:03 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Volume volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 (ed7b1426-d5c3-43f1-b4c2-82568ca34f16): created successfully Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf9c521-b1d1-45b8-84b2-995376298d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (16467f47-8d33-4bd3-9eb3-89d6a2c027df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-eb26c18d-d7f1-4ecc-b96c-a8faea0d94f7 tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:04 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d.425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-425814ef-f3d5-4e5d-9cbf-b1a15e1ba4fb" released by "_delete_snapshot" :: held 2.134s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-15cf70a6-66bb-4fd6-a295-c581b6956a8d" released by "delete_snapshot" :: held 2.145s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:04 devstack cinder-volume[82005]: WARNING cinder.quota [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-723225336 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-723225336, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:04 devstack cinder-volume[82005]: WARNING cinder.quota [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-723225336 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-723225336, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['33e4c1f5-6497-4ce7-80d4-8e518acf0b8e', 'd7f8eda1-d667-4482-a105-c3d8a193ae7a', '035b26a9-d5cb-4b79-ab77-5a1a82fd5440', 'b6962e7c-9de4-493f-90d1-0c4895fa8238'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['2a63e35a-3f46-487c-ab64-e73465bef0bd', 'e68df369-f8ce-409a-98bb-a4704a459276', '2c931797-c329-4ba8-a62f-664099d68205', '3b36f982-e31d-4440-8d35-d17b7142aa7c'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:04 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-dec8192c-cfbd-4056-bc18-68a5dfda6543 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 4d9b9741-e0a8-43ff-b8e6-e95aba67c46e: deleted successfully Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-ed7b1426-d5c3-43f1-b4c2-82568ca34f16-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Lock "cinder-ed7b1426-d5c3-43f1-b4c2-82568ca34f16-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-ed7b1426-d5c3-43f1-b4c2-82568ca34f16" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-ed7b1426-d5c3-43f1-b4c2-82568ca34f16" acquired by "delete_volume" :: waited 0.025s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d618f13e-ac11-4c7b-a43b-64a4a56bfc59]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 Apr 21 20:57:05 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-15cf70a6-66bb-4fd6-a295-c581b6956a8d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-15cf70a6-66bb-4fd6-a295-c581b6956a8d" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[149d58f6-0c87-43c5-b050-76be1a4fd6f4]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d Apr 21 20:57:05 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16" returned: 0 in 0.730s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16 Apr 21 20:57:05 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d" returned: 0 in 0.582s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d Apr 21 20:57:05 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ed7b1426-d5c3-43f1-b4c2-82568ca34f16" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-ed7b1426-d5c3-43f1-b4c2-82568ca34f16" released by "delete_volume" :: held 1.222s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Created reservations ['007349a3-cda1-42b4-8576-bae20dec098f', '4ba6ec9d-32b7-4465-8efc-0e933f42fabc', '4d421a26-2348-4fd8-9dc6-4d4645b96857', 'df373cfe-9ea5-4236-9e80-14894cdd3f5d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:06 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-15cf70a6-66bb-4fd6-a295-c581b6956a8d" returned: 0 in 0.518s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-15cf70a6-66bb-4fd6-a295-c581b6956a8d" released by "delete_volume" :: held 1.143s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cd582-39bf-450d-8342-cc164b1534e7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d Apr 21 20:57:06 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5faf2b0e-edd8-4598-9ba5-cdff65e5e475 tempest-VolumesGetTest-962889553 None] Lock "cinder-ed7b1426-d5c3-43f1-b4c2-82568ca34f16-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:07 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" returned: 0 in 0.579s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d Apr 21 20:57:07 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-30376ffe-81b9-49d1-a73c-9c0ee834c82d-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Lock "cinder-30376ffe-81b9-49d1-a73c-9c0ee834c82d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-30376ffe-81b9-49d1-a73c-9c0ee834c82d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-30376ffe-81b9-49d1-a73c-9c0ee834c82d" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e8a627-4965-4de4-9118-4a462072ffd1]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d Apr 21 20:57:07 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-c98c5514-4ab2-4c2b-a11e-0bbc7e693e3d" released by "delete_volume" :: held 1.119s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['ca2dbc19-e0ea-42c4-9ac7-742cdd27f327'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:07 devstack cinder-volume[82005]: WARNING cinder.quota [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-723225336 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-723225336, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['a14762de-c068-4824-8042-fb67cbc03d4a', 'c31e9123-0e70-4f05-8c85-f6443759df91', 'd3546895-3943-43fa-a641-24b262b60cca', 'f7252f3a-a5ed-4375-891e-2c5649f58668'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['baf0954a-3d6c-4535-9e71-95f9b6843383', 'c71a4d48-6372-448c-a612-5ae7f44183cb', '2f96f81a-99f7-4a94-badb-9c21cb0f30e1', 'b32c3c3b-bcaa-4777-a602-a2ffef6d8ad9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:07 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d" returned: 0 in 0.707s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d Apr 21 20:57:08 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.522s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d2e0a8ba-d34a-4e72-b35a-67f70daa1e38 tempest-GroupSnapshotsTest-1426332708 None] Delete group completed successfully. Apr 21 20:57:08 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-30376ffe-81b9-49d1-a73c-9c0ee834c82d" returned: 0 in 0.444s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-30376ffe-81b9-49d1-a73c-9c0ee834c82d" released by "delete_volume" :: held 1.176s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Created reservations ['27ec56e4-bf33-4464-833a-e71021d27183', 'b0fb5f76-06f7-4443-9953-c561c27c4488', '4b977a7f-9dd2-4b2f-987f-ea9e77054b1f', 'ea34f018-abbf-40fc-bd2f-fb320fb58064'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:08 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-968983d1-775d-4105-a7d4-82077512ae74 tempest-GroupSnapshotsTest-1426332708 None] Group tempest-GroupSnapshotsTest-Group-575647542: creating Apr 21 20:57:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-968983d1-775d-4105-a7d4-82077512ae74 tempest-GroupSnapshotsTest-1426332708 None] Group tempest-GroupSnapshotsTest-Group-575647542: created successfully Apr 21 20:57:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-968983d1-775d-4105-a7d4-82077512ae74 tempest-GroupSnapshotsTest-1426332708 None] Create group completed successfully. Apr 21 20:57:08 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.426s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:09 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cad0e99c-1a16-4589-bcf4-111a6fd19c8a tempest-VolumesGetTest-962889553 None] Lock "cinder-30376ffe-81b9-49d1-a73c-9c0ee834c82d-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (59e251cc-6d44-413c-9796-31eeaf348a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d16d845-1e4d-47c8-abd8-e4885d6e4028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d16d845-1e4d-47c8-abd8-e4885d6e4028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2005679363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b40faa2-f64c-4433-8455-1b566f626002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:10Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850c6cfc-8490-4e0e-8338-9cc6d0a33904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850c6cfc-8490-4e0e-8338-9cc6d0a33904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf7e19f-ed2b-4a30-b4af-f6ccdda4a360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf7e19f-ed2b-4a30-b4af-f6ccdda4a360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b40faa2-f64c-4433-8455-1b566f626002', 'volume_name': 'volume-3b40faa2-f64c-4433-8455-1b566f626002', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e293b31b-fac6-46b9-a81f-37fd4729cb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e293b31b-fac6-46b9-a81f-37fd4729cb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0646a30-d8b4-402c-bcb3-d0cc150a0775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Volume 3b40faa2-f64c-4433-8455-1b566f626002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b40faa2-f64c-4433-8455-1b566f626002', 'volume_size': 1} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2005679363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b40faa2-f64c-4433-8455-1b566f626002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:10Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Creating volume 3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:09 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 1073741824 Apr 21 20:57:09 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (c5a36ae3-7cd9-4b81-ac0c-0cea04cb8349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff66a7ac-944f-4e69-abf4-e983b478af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 1073741824" returned: 0 in 0.691s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff66a7ac-944f-4e69-abf4-e983b478af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1073390867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f47a7f9a-8bcc-42e9-a895-c436514b3972,host='devstack@QuobyteHD#QuobyteHD',id=661ea582-ae6a-48ed-b478-4f2b67966f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:10Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60ec3005-ca9a-467f-b7db-955f61a70efc),volume_type_id=60ec3005-ca9a-467f-b7db-955f61a70efc)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc2b50f-6fe7-4b47-b663-8dcab8bd7588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc2b50f-6fe7-4b47-b663-8dcab8bd7588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2569c3f4-4950-4fd3-8ce1-3c9f4c063c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2569c3f4-4950-4fd3-8ce1-3c9f4c063c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661ea582-ae6a-48ed-b478-4f2b67966f67', 'volume_name': 'volume-661ea582-ae6a-48ed-b478-4f2b67966f67', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d01cbf-e54f-4e00-83a2-4bf6ff2c80c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d01cbf-e54f-4e00-83a2-4bf6ff2c80c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dc21cf-7c67-4512-b3f2-dd0bfbc37a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Volume 661ea582-ae6a-48ed-b478-4f2b67966f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661ea582-ae6a-48ed-b478-4f2b67966f67', 'volume_size': 1} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:10 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.475s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f47a7f9a-8bcc-42e9-a895-c436514b3972,created_at=2026-04-21T18:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1073390867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f47a7f9a-8bcc-42e9-a895-c436514b3972,host='devstack@QuobyteHD#QuobyteHD',id=661ea582-ae6a-48ed-b478-4f2b67966f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730426dda0be4417a0015d3d19bb813f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:10Z,use_quota=True,user_id='104342d12338402995f18ebf824c2409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60ec3005-ca9a-467f-b7db-955f61a70efc),volume_type_id=60ec3005-ca9a-467f-b7db-955f61a70efc)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Creating volume 661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:11 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0646a30-d8b4-402c-bcb3-d0cc150a0775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b40faa2-f64c-4433-8455-1b566f626002', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556fdcb-600f-4d56-a242-2ebecb622b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:11 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Volume volume-3b40faa2-f64c-4433-8455-1b566f626002 (3b40faa2-f64c-4433-8455-1b566f626002): created successfully Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556fdcb-600f-4d56-a242-2ebecb622b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:11 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 1073741824 Apr 21 20:57:11 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (59e251cc-6d44-413c-9796-31eeaf348a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:11 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0f43c526-f21b-4383-9066-92a96abeda1c tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:11 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 1073741824" returned: 0 in 0.657s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 Apr 21 20:57:11 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (a7f30019-7d8a-4d57-b753-0005f03487d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0683ac3a-e36f-4e93-9b8c-894fefcf474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0683ac3a-e36f-4e93-9b8c-894fefcf474a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-785547203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a1126f-452a-409e-9acb-4e776d0b877b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3b40faa2-f64c-4433-8455-1b566f626002,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:12Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5055a2c9-2bad-4dfe-b0ff-95b9894f3775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5055a2c9-2bad-4dfe-b0ff-95b9894f3775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6213b-eee6-4c3a-9eaa-0dd0f7ca07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6213b-eee6-4c3a-9eaa-0dd0f7ca07b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f9a1126f-452a-409e-9acb-4e776d0b877b', 'volume_name': 'volume-f9a1126f-452a-409e-9acb-4e776d0b877b', 'volume_size': 1, 'source_volid': '3b40faa2-f64c-4433-8455-1b566f626002', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56c9f08-10ba-4420-96a5-f4664a98a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56c9f08-10ba-4420-96a5-f4664a98a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770db5bd-6925-4f39-9e3c-b120a645e0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Volume f9a1126f-452a-409e-9acb-4e776d0b877b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f9a1126f-452a-409e-9acb-4e776d0b877b', 'volume_size': 1, 'source_volid': '3b40faa2-f64c-4433-8455-1b566f626002', 'source_volstatus': 'available'} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:12 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67" returned: 0 in 0.635s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.113s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:12 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Cloning volume 3b40faa2-f64c-4433-8455-1b566f626002 to volume f9a1126f-452a-409e-9acb-4e776d0b877b Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dc21cf-7c67-4512-b3f2-dd0bfbc37a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661ea582-ae6a-48ed-b478-4f2b67966f67', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e11340b-439e-4f45-97e1-91d547ee492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Volume volume-661ea582-ae6a-48ed-b478-4f2b67966f67 (661ea582-ae6a-48ed-b478-4f2b67966f67): created successfully Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e11340b-439e-4f45-97e1-91d547ee492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Flow 'volume_create_manager' (c5a36ae3-7cd9-4b81-ac0c-0cea04cb8349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Creating offline snapshot 0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 of volume 3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:12 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-90b33a53-ae07-447c-938c-06edb3da5c44 tempest-GroupSnapshotsTest-1426332708 None] Created volume successfully. Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b33795-8773-43f2-b37f-cffc3bb3197d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:12 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] GroupSnapshot 78ebab57-b434-49a9-9fb8-d237febf3cab: creating. Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Group snapshot 78ebab57-b434-49a9-9fb8-d237febf3cab: creating. {{(pid=82005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:57:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:13 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.709s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 1G Apr 21 20:57:13 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 1G" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b40faa2-f64c-4433-8455-1b566f626002 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b40faa2-f64c-4433-8455-1b566f626002 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 Apr 21 20:57:13 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b40faa2-f64c-4433-8455-1b566f626002 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" returned: 0 in 0.566s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 is being set with open permissions: ugo+rw Apr 21 20:57:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 Apr 21 20:57:14 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" returned: 0 in 0.583s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info Apr 21 20:57:15 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Flow 'volume_create_manager' (e4f3ea22-4f71-48f8-bcdb-4e51c673864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901d81d0-3411-4cba-bfe8-7b17fb731d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901d81d0-3411-4cba-bfe8-7b17fb731d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1896829212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f655f518-b57a-493d-a897-980b47345d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b54d65547a5c4224a525569287d9dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:15Z,use_quota=True,user_id='0cb291866cee445f920836cca82e773e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d04258f-2b39-4f62-89ee-ecc1f7096402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d04258f-2b39-4f62-89ee-ecc1f7096402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dd1c7b-c443-49b6-a59f-3139f271cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dd1c7b-c443-49b6-a59f-3139f271cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f655f518-b57a-493d-a897-980b47345d7a', 'volume_name': 'volume-f655f518-b57a-493d-a897-980b47345d7a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f40ccd-868f-41b6-9d51-ed1dd5e3d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f40ccd-868f-41b6-9d51-ed1dd5e3d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98166ef9-9747-44ef-a0b9-52a70c8c71ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Volume f655f518-b57a-493d-a897-980b47345d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f655f518-b57a-493d-a897-980b47345d7a', 'volume_size': 1} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info is being set with open permissions: ugo+rw Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info Apr 21 20:57:15 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Flow 'volume_create_manager' (7e04e822-bb49-4b08-a32d-fa1cef898f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f7b753-1b59-4a5b-8740-7658bae54c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f7b753-1b59-4a5b-8740-7658bae54c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-712130501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7750832-6f5b-4407-b2cc-7e5e599980e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6af21626d040a4941abe25986ebc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:15Z,use_quota=True,user_id='a81e2ca6d06c4252a62ffb711fc53ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d22119-db00-4e79-aca6-28c94f1e73bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d22119-db00-4e79-aca6-28c94f1e73bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bb436d-22a3-4008-a090-50b358fb859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bb436d-22a3-4008-a090-50b358fb859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7750832-6f5b-4407-b2cc-7e5e599980e8', 'volume_name': 'volume-e7750832-6f5b-4407-b2cc-7e5e599980e8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fab961-22d8-48c8-b338-81d696078f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fab961-22d8-48c8-b338-81d696078f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9207a347-6097-4ee9-9fc7-30bbb3cffe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Volume e7750832-6f5b-4407-b2cc-7e5e599980e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7750832-6f5b-4407-b2cc-7e5e599980e8', 'volume_size': 1} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.info" returned: 0 in 0.386s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-f9a1126f-452a-409e-9acb-4e776d0b877b" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-f9a1126f-452a-409e-9acb-4e776d0b877b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] snapshot: 0f2979fe-9b7b-4c46-86e6-7e4eda6310a9, volume: f9a1126f-452a-409e-9acb-4e776d0b877b, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f06132f-489a-4369-b5fd-2fbebf761135]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 Apr 21 20:57:15 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" returned: 0 in 0.443s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b40faa2-f64c-4433-8455-1b566f626002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad58d982-5094-4b45-a78a-2ae794cde923]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:16 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b Apr 21 20:57:16 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b" returned: 0 in 1.830s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fff33-9012-4518-9330-3d7d5bd183c0]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:18 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:19 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Converted 1024.00 MB image at 559.05 MB/s Apr 21 20:57:19 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b is being set with open permissions: ugo+rw Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b Apr 21 20:57:19 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b" returned: 0 in 0.380s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-f9a1126f-452a-409e-9acb-4e776d0b877b" released by "_copy_volume_from_snapshot" :: held 3.730s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Deleting offline snapshot 0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 of volume 3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] snapshot_file for this snap is: volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc961e-5426-4c2f-9999-df6bf2b48b15]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 Apr 21 20:57:19 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b40faa2-f64c-4433-8455-1b566f626002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[452605e4-b4ca-43d8-a487-013113ea8ab1]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:20 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.437s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 Apr 21 20:57:20 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" returned: 0 in 0.434s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9 Apr 21 20:57:20 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002.0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" returned: 0 in 0.412s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-0f2979fe-9b7b-4c46-86e6-7e4eda6310a9" released by "_delete_snapshot" :: held 1.786s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.931s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.534s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770db5bd-6925-4f39-9e3c-b120a645e0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a1126f-452a-409e-9acb-4e776d0b877b', 'volume_size': 1, 'source_volid': '3b40faa2-f64c-4433-8455-1b566f626002', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568f636d-d7df-4051-8ae5-99cd9986fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Creating offline snapshot 828ca05c-8cb2-4f38-89d5-a23af0ba872a of volume 661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:21 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Volume volume-f9a1126f-452a-409e-9acb-4e776d0b877b (f9a1126f-452a-409e-9acb-4e776d0b877b): created successfully Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568f636d-d7df-4051-8ae5-99cd9986fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (a7f30019-7d8a-4d57-b753-0005f03487d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[23950977-0692-4b14-8189-c7d235e18248]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9b2776e4-207b-48f6-a2df-cc99b232bcdf tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:21 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 Apr 21 20:57:21 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a 1G Apr 21 20:57:21 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (dfeca052-7523-429f-b193-9b2943e252aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7c90a9-45ff-4bbe-aab8-b40f8fef689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7c90a9-45ff-4bbe-aab8-b40f8fef689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1373828333',display_name='tempest-VolumesGetTest-Volume-1054070572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06d8fe0-229b-441e-b4c1-cd38234ff3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:22Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a0220c-df92-40f8-9f45-4ca2a15cdf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a0220c-df92-40f8-9f45-4ca2a15cdf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf4ec87-ddda-42c4-8b3d-e94a40efec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf4ec87-ddda-42c4-8b3d-e94a40efec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06d8fe0-229b-441e-b4c1-cd38234ff3d8', 'volume_name': 'volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261c98cc-e7af-43d8-9581-bae4eea3e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261c98cc-e7af-43d8-9581-bae4eea3e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37136e5c-0c95-4018-9ece-90bbc22a7885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Volume b06d8fe0-229b-441e-b4c1-cd38234ff3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8', 'volume_size': 1} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:22 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a 1G" returned: 0 in 0.495s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661ea582-ae6a-48ed-b478-4f2b67966f67 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661ea582-ae6a-48ed-b478-4f2b67966f67 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a Apr 21 20:57:22 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661ea582-ae6a-48ed-b478-4f2b67966f67 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a" returned: 0 in 0.407s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a Apr 21 20:57:22 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a" returned: 0 in 0.381s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info Apr 21 20:57:23 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info" returned: 0 in 0.382s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info Apr 21 20:57:23 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.info" returned: 0 in 0.382s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.837s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1896829212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f655f518-b57a-493d-a897-980b47345d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b54d65547a5c4224a525569287d9dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:15Z,use_quota=True,user_id='0cb291866cee445f920836cca82e773e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Creating volume f655f518-b57a-493d-a897-980b47345d7a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:24 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a 1073741824 Apr 21 20:57:24 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-12e3dd19-4060-4674-acbc-218de04521c5 tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 78ebab57-b434-49a9-9fb8-d237febf3cab: created successfully Apr 21 20:57:24 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 78ebab57-b434-49a9-9fb8-d237febf3cab: deleting Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 78ebab57-b434-49a9-9fb8-d237febf3cab: deleting {{(pid=82005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-661ea582-ae6a-48ed-b478-4f2b67966f67" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-661ea582-ae6a-48ed-b478-4f2b67966f67" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-828ca05c-8cb2-4f38-89d5-a23af0ba872a" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-828ca05c-8cb2-4f38-89d5-a23af0ba872a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Deleting offline snapshot 828ca05c-8cb2-4f38-89d5-a23af0ba872a of volume 661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] snapshot_file for this snap is: volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6961875-d77f-448b-9f8d-d4e40b44b82c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a 1073741824" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a Apr 21 20:57:24 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a Apr 21 20:57:24 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-661ea582-ae6a-48ed-b478-4f2b67966f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:24 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a" returned: 0 in 0.406s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[274434e2-55be-4859-9441-2a9e1ef6db31]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.444s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-712130501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7750832-6f5b-4407-b2cc-7e5e599980e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6af21626d040a4941abe25986ebc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:15Z,use_quota=True,user_id='a81e2ca6d06c4252a62ffb711fc53ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Creating volume e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:24 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98166ef9-9747-44ef-a0b9-52a70c8c71ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f655f518-b57a-493d-a897-980b47345d7a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf34df61-08a2-4a7a-a411-7f06f529ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:24 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 1073741824 Apr 21 20:57:24 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Volume volume-f655f518-b57a-493d-a897-980b47345d7a (f655f518-b57a-493d-a897-980b47345d7a): created successfully Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf34df61-08a2-4a7a-a411-7f06f529ff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Flow 'volume_create_manager' (e4f3ea22-4f71-48f8-bcdb-4e51c673864c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0ece85ae-1b1b-4464-b662-2a1b3ebc7510 tempest-VolumesServicesTestJSON-1122381062 None] Created volume successfully. Apr 21 20:57:25 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 Apr 21 20:57:25 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 1073741824" returned: 0 in 0.476s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a Apr 21 20:57:25 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:57:25 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Acquiring lock "cinder-f655f518-b57a-493d-a897-980b47345d7a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Lock "cinder-f655f518-b57a-493d-a897-980b47345d7a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Acquiring lock "cinder-quobyte-f655f518-b57a-493d-a897-980b47345d7a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Lock "cinder-quobyte-f655f518-b57a-493d-a897-980b47345d7a" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f868eac-49fc-4451-ad60-018c2a3bea8c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a Apr 21 20:57:25 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.600s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1373828333',display_name='tempest-VolumesGetTest-Volume-1054070572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06d8fe0-229b-441e-b4c1-cd38234ff3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:22Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Creating volume b06d8fe0-229b-441e-b4c1-cd38234ff3d8 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:25 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a Apr 21 20:57:25 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:25 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9207a347-6097-4ee9-9fc7-30bbb3cffe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7750832-6f5b-4407-b2cc-7e5e599980e8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:25 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 1073741824 Apr 21 20:57:25 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c746282c-8b25-47ce-8536-7199b0dac30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:25 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Volume volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 (e7750832-6f5b-4407-b2cc-7e5e599980e8): created successfully Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c746282c-8b25-47ce-8536-7199b0dac30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Flow 'volume_create_manager' (7e04e822-bb49-4b08-a32d-fa1cef898f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f805cf49-183a-44ce-b925-a7a464e36433 tempest-VolumesActionsTest-1166073924 None] Created volume successfully. Apr 21 20:57:26 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a" returned: 0 in 0.482s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a Apr 21 20:57:26 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67.828ca05c-8cb2-4f38-89d5-a23af0ba872a" returned: 0 in 0.399s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-828ca05c-8cb2-4f38-89d5-a23af0ba872a" released by "_delete_snapshot" :: held 1.898s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-661ea582-ae6a-48ed-b478-4f2b67966f67" released by "delete_snapshot" :: held 1.921s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:26 devstack cinder-volume[82005]: WARNING cinder.quota [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2094953867 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2094953867, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:26 devstack cinder-volume[82005]: WARNING cinder.quota [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2094953867 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2094953867, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['423b5933-680a-46cc-9e7d-231e18daba48', '1cfa59cd-bc73-48cd-be78-41b4a392ea8f', '6388d111-8cfc-4e7f-930c-464cb90fdb18', 'cfe14bad-035c-42de-8529-72f3938b4d4d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:26 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-50df7c58-70a8-49b4-a0a7-e4946d2acfba tempest-GroupSnapshotsTest-1426332708 None] group_snapshot 78ebab57-b434-49a9-9fb8-d237febf3cab: deleted successfully Apr 21 20:57:26 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 1073741824" returned: 0 in 0.540s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 Apr 21 20:57:26 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f655f518-b57a-493d-a897-980b47345d7a" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Lock "cinder-quobyte-f655f518-b57a-493d-a897-980b47345d7a" released by "delete_volume" :: held 0.950s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Created reservations ['d9fd6eb9-f3fe-41c9-a01a-fb3f53690ea0', 'e7369695-148e-48fc-b586-0498765081f5', '27bb9739-9a6a-45e2-bfb0-5809427077a5', 'f073db61-30c0-4b3a-922a-cffeafb362f3'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "cinder-quobyte-661ea582-ae6a-48ed-b478-4f2b67966f67" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-661ea582-ae6a-48ed-b478-4f2b67966f67" acquired by "delete_volume" :: waited 0.024s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cebad-af83-4045-9e7d-619aa11c652f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:26 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 Apr 21 20:57:26 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37136e5c-0c95-4018-9ece-90bbc22a7885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616f4ca1-8ccc-40cf-af3c-7ea21eacd4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Volume volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 (b06d8fe0-229b-441e-b4c1-cd38234ff3d8): created successfully Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616f4ca1-8ccc-40cf-af3c-7ea21eacd4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (dfeca052-7523-429f-b193-9b2943e252aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-86f3e9db-de55-449d-bcc2-f72e14b4203f tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:27 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.459s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Deleted volume successfully. Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6e8a216c-f0b3-4fbd-8bc4-0bfe12e1c611 tempest-VolumesServicesTestJSON-1122381062 None] Lock "cinder-f655f518-b57a-493d-a897-980b47345d7a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67" returned: 0 in 0.527s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67 Apr 21 20:57:27 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-b06d8fe0-229b-441e-b4c1-cd38234ff3d8-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Lock "cinder-b06d8fe0-229b-441e-b4c1-cd38234ff3d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-b06d8fe0-229b-441e-b4c1-cd38234ff3d8" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-b06d8fe0-229b-441e-b4c1-cd38234ff3d8" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ebd856-05f0-4be8-8a6c-69ccd51502fa]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-661ea582-ae6a-48ed-b478-4f2b67966f67" returned: 0 in 0.513s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 Apr 21 20:57:27 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Lock "cinder-quobyte-661ea582-ae6a-48ed-b478-4f2b67966f67" released by "delete_volume" :: held 1.071s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['293a4fd3-3861-44cd-a88f-3154004b1b0a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:27 devstack cinder-volume[82005]: WARNING cinder.quota [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2094953867 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2094953867, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Created reservations ['29660ff0-07e1-49f0-b5f6-8433cb2a7497', '1dbd876b-42d7-4265-90a7-fd831a9c8112', '69d5a77e-809b-4ab7-a7cc-a79a9518f447', 'a75209f1-efdf-4c81-9108-f6e3c5e6c55d'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:28 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8" returned: 0 in 0.563s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8 Apr 21 20:57:28 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.544s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:28 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-aa52de1c-bc18-4e0d-bc88-1314e595b3ea tempest-GroupSnapshotsTest-1426332708 None] Delete group completed successfully. Apr 21 20:57:28 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b06d8fe0-229b-441e-b4c1-cd38234ff3d8" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-b06d8fe0-229b-441e-b4c1-cd38234ff3d8" released by "delete_volume" :: held 1.033s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Created reservations ['93554e44-64f8-4a97-b1d1-805426fb6a43', 'ef996df3-ea3e-4461-97c2-6987bfd24bf8', '66ec8a07-6dba-4cec-b97b-c0b6c6aece46', '938f0310-ef95-4c5f-9f4e-77a3dfd3b786'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:28 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=248,cinder:INSERT=66,cinder:UPDATE=300,cinder:DELETE=18 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8521c4c0-95ad-4de6-a425-14af4ccca64d tempest-VolumesGetTest-962889553 None] Lock "cinder-b06d8fe0-229b-441e-b4c1-cd38234ff3d8-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-f9a1126f-452a-409e-9acb-4e776d0b877b-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Lock "cinder-f9a1126f-452a-409e-9acb-4e776d0b877b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-f9a1126f-452a-409e-9acb-4e776d0b877b" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-f9a1126f-452a-409e-9acb-4e776d0b877b" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dab5e9-f408-4252-92d2-ac7405ac6e0e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b Apr 21 20:57:30 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b" returned: 0 in 0.573s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b Apr 21 20:57:30 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9a1126f-452a-409e-9acb-4e776d0b877b" returned: 0 in 0.483s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-f9a1126f-452a-409e-9acb-4e776d0b877b" released by "delete_volume" :: held 1.089s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Created reservations ['2f0aa344-1c47-4ea9-a12f-60d9ab63df16', 'ef915de5-92e7-4e1d-aa02-542265c7f029', 'a9e4f203-ff75-4f9c-969c-b216b97516c1', '25c37313-cfe1-4c36-be9a-71853825e9e4'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:31 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:31 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Flow 'volume_create_manager' (33e3098f-27a0-4dd1-be57-9a93866e4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747fbe1f-df51-4131-9c88-9c560e69b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.519s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:31 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747fbe1f-df51-4131-9c88-9c560e69b875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1409058558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bb6861-4707-4425-a136-03cdec9fb798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9c00ee35fc4769a3a662a7801fae9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:32Z,use_quota=True,user_id='5439d88baf2e4bbab91c4b372baa1b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da760b18-0367-44a2-a53a-2f962ae74b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da760b18-0367-44a2-a53a-2f962ae74b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed40f6b8-64d0-4836-8651-af79776a2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed40f6b8-64d0-4836-8651-af79776a2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bb6861-4707-4425-a136-03cdec9fb798', 'volume_name': 'volume-28bb6861-4707-4425-a136-03cdec9fb798', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8269b15-27d1-4a6c-b4c5-fcd2767a7862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8269b15-27d1-4a6c-b4c5-fcd2767a7862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e0546-e77a-402a-b05f-477049a93efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:31 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Volume 28bb6861-4707-4425-a136-03cdec9fb798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bb6861-4707-4425-a136-03cdec9fb798', 'volume_size': 1} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1409058558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bb6861-4707-4425-a136-03cdec9fb798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9c00ee35fc4769a3a662a7801fae9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:32Z,use_quota=True,user_id='5439d88baf2e4bbab91c4b372baa1b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Creating volume 28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:31 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a60f8b9-3c9c-4f9d-a11c-4a3cd6d496f9 tempest-VolumesGetTest-962889553 None] Lock "cinder-f9a1126f-452a-409e-9acb-4e776d0b877b-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:31 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 1073741824 Apr 21 20:57:31 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-3b40faa2-f64c-4433-8455-1b566f626002-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Lock "cinder-3b40faa2-f64c-4433-8455-1b566f626002-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-3b40faa2-f64c-4433-8455-1b566f626002" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-3b40faa2-f64c-4433-8455-1b566f626002" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e251f8cd-31d5-4727-9e4c-061cb8d79eed]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 1073741824" returned: 0 in 0.664s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack sudo[86846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:32 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 Apr 21 20:57:32 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-68643139-8e78-4878-b58a-b24452bc2edd tempest-GroupSnapshotsV319Test-14595453 None] Group tempest-GroupSnapshotsV319Test-Group-1165722749: creating Apr 21 20:57:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-68643139-8e78-4878-b58a-b24452bc2edd tempest-GroupSnapshotsV319Test-14595453 None] Group tempest-GroupSnapshotsV319Test-Group-1165722749: created successfully Apr 21 20:57:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-68643139-8e78-4878-b58a-b24452bc2edd tempest-GroupSnapshotsV319Test-14595453 None] Create group completed successfully. Apr 21 20:57:32 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.602s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002 Apr 21 20:57:32 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e0546-e77a-402a-b05f-477049a93efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bb6861-4707-4425-a136-03cdec9fb798', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0fbc9f-6865-4bb8-98c2-1b107bedcc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Volume volume-28bb6861-4707-4425-a136-03cdec9fb798 (28bb6861-4707-4425-a136-03cdec9fb798): created successfully Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0fbc9f-6865-4bb8-98c2-1b107bedcc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Flow 'volume_create_manager' (33e3098f-27a0-4dd1-be57-9a93866e4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e069e720-36a1-48dc-b5dd-a17111183dac tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Created volume successfully. Apr 21 20:57:33 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b40faa2-f64c-4433-8455-1b566f626002" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-3b40faa2-f64c-4433-8455-1b566f626002" released by "delete_volume" :: held 1.074s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Created reservations ['b9fdf1ae-2ddf-4022-abe7-81befe84686f', '3c58383d-ffa9-40e5-b8e8-1e6520cafb73', '20d9aab8-af8b-4032-8525-5e43ede5c65e', '9577d0c9-474e-4e90-8709-18b4fdca9186'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:33 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.404s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:33 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-02ea635a-a6e6-467c-9e8f-5c30a0ab67eb tempest-VolumesGetTest-962889553 None] Lock "cinder-3b40faa2-f64c-4433-8455-1b566f626002-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Flow 'volume_create_manager' (c0b934e9-f9a0-47d4-8fec-252481d0413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4b706c-620e-4ed8-88da-967f7ca07454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4b706c-620e-4ed8-88da-967f7ca07454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1533982588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae8a97d2-734d-4112-9b89-288bd61ccc0a,host='devstack@QuobyteHD#QuobyteHD',id=f7a2bdd7-b801-4148-8306-ea7a3a0c27e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f9620440c494eb99df35c49e7f5e1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:34Z,use_quota=True,user_id='fb6bec67d3f1422f98c7e44f3ee45ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70437c00-77c0-4249-a2c3-5fdea44523b6),volume_type_id=70437c00-77c0-4249-a2c3-5fdea44523b6)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60586f8e-254b-4e50-b760-0eb40ce5f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60586f8e-254b-4e50-b760-0eb40ce5f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712921f8-e9f1-437f-866c-14e149cda19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712921f8-e9f1-437f-866c-14e149cda19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a2bdd7-b801-4148-8306-ea7a3a0c27e0', 'volume_name': 'volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49882729-b0a2-4c5b-920b-b36c2bb09493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49882729-b0a2-4c5b-920b-b36c2bb09493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d6494e-10d1-4bfa-b0a6-582948f7615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Volume f7a2bdd7-b801-4148-8306-ea7a3a0c27e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0', 'volume_size': 1} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ae8a97d2-734d-4112-9b89-288bd61ccc0a,created_at=2026-04-21T18:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1533982588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae8a97d2-734d-4112-9b89-288bd61ccc0a,host='devstack@QuobyteHD#QuobyteHD',id=f7a2bdd7-b801-4148-8306-ea7a3a0c27e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f9620440c494eb99df35c49e7f5e1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:34Z,use_quota=True,user_id='fb6bec67d3f1422f98c7e44f3ee45ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70437c00-77c0-4249-a2c3-5fdea44523b6),volume_type_id=70437c00-77c0-4249-a2c3-5fdea44523b6)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Creating volume f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:34 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:34 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 1073741824 Apr 21 20:57:34 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 1073741824" returned: 0 in 0.538s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 Apr 21 20:57:34 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (f38cd70d-c450-4d64-bd73-fe4270385ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324a15a-404c-4dd1-a1a2-9719df31a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324a15a-404c-4dd1-a1a2-9719df31a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922924980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e74da4-2575-4277-902d-beb35536bb37,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:35Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fba0be3-6edd-4ef0-b176-f541f8d68dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fba0be3-6edd-4ef0-b176-f541f8d68dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f16203-9ced-4295-b0a0-e78dba4f37ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.image.glance [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Creating Keystone auth plugin from conf {{(pid=82005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:57:34 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" returned: 0 in 0.426s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.977s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d6494e-10d1-4bfa-b0a6-582948f7615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5987d2c-35ae-49fc-bcbf-83f0a462094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Creating offline snapshot be44a625-99df-421f-a089-f567e92dff01 of volume 28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:35 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Volume volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 (f7a2bdd7-b801-4148-8306-ea7a3a0c27e0): created successfully Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5987d2c-35ae-49fc-bcbf-83f0a462094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Flow 'volume_create_manager' (c0b934e9-f9a0-47d4-8fec-252481d0413c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b926b9-44a0-4e73-ba64-203ff9527d86]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-664c93bf-ea11-4b6e-a74f-f0efeba0c90f tempest-GroupSnapshotsV319Test-14595453 None] Created volume successfully. Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f16203-9ced-4295-b0a0-e78dba4f37ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86e74da4-2575-4277-902d-beb35536bb37', 'volume_name': 'volume-86e74da4-2575-4277-902d-beb35536bb37', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e11b577-8574-482c-9fe2-0f4f8e8b4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e11b577-8574-482c-9fe2-0f4f8e8b4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275e7a97-0e12-4dda-8624-d861bbc887d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:35 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Volume 86e74da4-2575-4277-902d-beb35536bb37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86e74da4-2575-4277-902d-beb35536bb37', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Trying to clone 86e74da4-2575-4277-902d-beb35536bb37 from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]). {{(pid=82005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:57:35 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 Apr 21 20:57:35 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:57:35 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c099685-a704-4590-b42e-9a4e906301ab]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD Apr 21 20:57:35 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 1G Apr 21 20:57:35 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f is fetched for user 486cb43d16dc4bd99209f8217854a87f. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d80e5a4-6047-4d36-831d-d37b7d33f24d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD Apr 21 20:57:35 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 1G" returned: 0 in 0.502s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28bb6861-4707-4425-a136-03cdec9fb798 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28bb6861-4707-4425-a136-03cdec9fb798 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 Apr 21 20:57:36 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] GroupSnapshot e0cddee9-c8df-4f7e-b1fd-2966dea8820c: creating. Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Group snapshot e0cddee9-c8df-4f7e-b1fd-2966dea8820c: creating. {{(pid=82005) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:36 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:36 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28bb6861-4707-4425-a136-03cdec9fb798 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01" returned: 0 in 0.435s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 is being set with open permissions: ugo+rw Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 Apr 21 20:57:36 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:36 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info Apr 21 20:57:37 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info" returned: 0 in 0.387s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info is being set with open permissions: ugo+rw Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info Apr 21 20:57:37 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.info" returned: 0 in 0.409s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.604s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Creating offline snapshot aeac2968-5b5e-4bf5-b2af-56f9387ee907 of volume f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3472e2ee-d856-4628-a81e-0c8b6f9da57f tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Create snapshot completed successfully Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f9738d-cff2-42cc-bcd3-73b5955f7c00]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 Apr 21 20:57:37 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "cinder-be44a625-99df-421f-a089-f567e92dff01-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-be44a625-99df-421f-a089-f567e92dff01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "cinder-quobyte-28bb6861-4707-4425-a136-03cdec9fb798" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-quobyte-28bb6861-4707-4425-a136-03cdec9fb798" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "cinder-quobyte-be44a625-99df-421f-a089-f567e92dff01" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-quobyte-be44a625-99df-421f-a089-f567e92dff01" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Deleting offline snapshot be44a625-99df-421f-a089-f567e92dff01 of volume 28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] snapshot_file for this snap is: volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b030fc-9893-4410-a706-673bad60926c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:38 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" returned: 0 in 0.783s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:38 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 1G Apr 21 20:57:38 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:38 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 Apr 21 20:57:38 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01" returned: 0 in 0.595s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28bb6861-4707-4425-a136-03cdec9fb798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b96a8b-7cfb-434a-a683-2b4f6202718e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 1G" returned: 0 in 0.591s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 Apr 21 20:57:39 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 Apr 21 20:57:39 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798" returned: 0 in 0.537s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907" returned: 0 in 0.473s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 Apr 21 20:57:39 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 Apr 21 20:57:39 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907" returned: 0 in 0.402s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info Apr 21 20:57:40 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01 Apr 21 20:57:40 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c649b541-e30e-4c4a-ab96-212a534cc93b tempest-VolumesActionsTest-1166073924 None] Acquiring lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8" by "attach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c649b541-e30e-4c4a-ab96-212a534cc93b tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8" acquired by "attach_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c649b541-e30e-4c4a-ab96-212a534cc93b tempest-VolumesActionsTest-1166073924 None] Attaching volume e7750832-6f5b-4407-b2cc-7e5e599980e8 to instance 4c76acd1-130b-4755-8b59-3291ad382dae at mountpoint /dev/vdb on host None. Apr 21 20:57:40 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c649b541-e30e-4c4a-ab96-212a534cc93b tempest-VolumesActionsTest-1166073924 None] Attach volume completed successfully. Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info" returned: 0 in 0.491s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c649b541-e30e-4c4a-ab96-212a534cc93b tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8" released by "attach_volume" :: held 0.069s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:40 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info Apr 21 20:57:40 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798.be44a625-99df-421f-a089-f567e92dff01" returned: 0 in 0.537s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-quobyte-be44a625-99df-421f-a089-f567e92dff01" released by "_delete_snapshot" :: held 2.205s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-quobyte-28bb6861-4707-4425-a136-03cdec9fb798" released by "delete_snapshot" :: held 2.221s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Created reservations ['170aa525-4e51-455b-a53b-7fdbe92ad582', '7aacb8e5-6b37-44cf-922c-4a6f4ea37d32', 'b1b765bc-9b8a-4ce3-b8f6-9ef2abed2bc8', '5efce782-fb5c-4d7a-90d1-66e131f03d88'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Delete snapshot completed successfully. Apr 21 20:57:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-20ee3eb0-5823-414d-b038-b6c5ecb2cb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-be44a625-99df-421f-a089-f567e92dff01-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.info" returned: 0 in 0.403s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.728s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922924980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e74da4-2575-4277-902d-beb35536bb37,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:35Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Creating volume 86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:41 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 1073741824 Apr 21 20:57:41 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-1377a97e-4372-456a-ac25-95bd5072d382 tempest-GroupSnapshotsV319Test-14595453 None] group_snapshot e0cddee9-c8df-4f7e-b1fd-2966dea8820c: created successfully Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff6dcc62-d834-4ca2-a9ef-1aec75cfc35c tempest-VolumesActionsTest-1166073924 None] Acquiring lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-detach_volume" by "detach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff6dcc62-d834-4ca2-a9ef-1aec75cfc35c tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ff6dcc62-d834-4ca2-a9ef-1aec75cfc35c tempest-VolumesActionsTest-1166073924 None] Detaching volume e7750832-6f5b-4407-b2cc-7e5e599980e8 from instance 4c76acd1-130b-4755-8b59-3291ad382dae. Apr 21 20:57:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ff6dcc62-d834-4ca2-a9ef-1aec75cfc35c tempest-VolumesActionsTest-1166073924 None] Detach volume completed successfully. Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff6dcc62-d834-4ca2-a9ef-1aec75cfc35c tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 1073741824" returned: 0 in 0.519s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:41 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "cinder-28bb6861-4707-4425-a136-03cdec9fb798-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-28bb6861-4707-4425-a136-03cdec9fb798-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "cinder-quobyte-28bb6861-4707-4425-a136-03cdec9fb798" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-quobyte-28bb6861-4707-4425-a136-03cdec9fb798" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[178dde5f-93ea-4ac7-b9e9-ee53e65be6f6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[87010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 Apr 21 20:57:41 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] group_snapshot e0cddee9-c8df-4f7e-b1fd-2966dea8820c: deleting Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] group_snapshot e0cddee9-c8df-4f7e-b1fd-2966dea8820c: deleting {{(pid=82005) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "cinder-quobyte-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Lock "cinder-quobyte-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "cinder-quobyte-aeac2968-5b5e-4bf5-b2af-56f9387ee907" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Lock "cinder-quobyte-aeac2968-5b5e-4bf5-b2af-56f9387ee907" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Deleting offline snapshot aeac2968-5b5e-4bf5-b2af-56f9387ee907 of volume f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] snapshot_file for this snap is: volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e1cac9-0ddc-4830-8cb4-b0097779094c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 Apr 21 20:57:42 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 0 in 0.631s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Attempting download of 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume 86e74da4-2575-4277-902d-beb35536bb37. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8465e9-b81d-4917-83d5-066f349fe38a]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv Apr 21 20:57:42 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798" returned: 0 in 0.670s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798 Apr 21 20:57:42 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907" returned: 0 in 0.584s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f639a-a4dd-4803-bc1e-73bcd5213594]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 Apr 21 20:57:42 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv" returned: 0 in 0.548s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv Apr 21 20:57:42 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-28bb6861-4707-4425-a136-03cdec9fb798" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-quobyte-28bb6861-4707-4425-a136-03cdec9fb798" released by "delete_volume" :: held 1.186s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Created reservations ['452fae7d-7c01-4ecf-bde0-8e04af2fda6e', 'f388f855-3549-4c4f-9f39-5055a94f3a03', 'c402185c-6814-4b03-affa-07d21c9528a3', '81c18cdf-2169-4485-940c-0815ec9e63f9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:43 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" returned: 0 in 0.628s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 Apr 21 20:57:43 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv" returned: 1 in 0.625s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_ky_ua0rv' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3b71ce-12c5-4792-b349-5809dbb1b526]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD Apr 21 20:57:43 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.627s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Deleted volume successfully. Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9100bde0-9d89-47e3-91bf-4da7e147fe33 tempest-VolumeSnapshotQuotasNegativeTestJSON-1771867757 None] Lock "cinder-28bb6861-4707-4425-a136-03cdec9fb798-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:43 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907" returned: 0 in 0.547s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907 Apr 21 20:57:43 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f was qcow2, converting to raw {{(pid=82005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:57:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:43 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0.aeac2968-5b5e-4bf5-b2af-56f9387ee907" returned: 0 in 0.480s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Lock "cinder-quobyte-aeac2968-5b5e-4bf5-b2af-56f9387ee907" released by "_delete_snapshot" :: held 2.294s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Lock "cinder-quobyte-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" released by "delete_snapshot" :: held 2.308s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:44 devstack cinder-volume[82005]: WARNING cinder.quota [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-547515333 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-547515333, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:44 devstack cinder-volume[82005]: WARNING cinder.quota [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-547515333 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-547515333, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:44 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] Created reservations ['5e8c205f-e537-4a96-89e9-d603c3d0fc57', '94476e4e-1966-4c15-81dd-658d33b70c5b', 'c42cf445-6730-4e62-bd7d-ce0c8d8ca2de', '7815d59e-f39b-42c5-9b7c-df409d847390'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:44 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a4a132f5-be8c-4620-83a0-cc4149868854 tempest-GroupSnapshotsV319Test-14595453 None] group_snapshot e0cddee9-c8df-4f7e-b1fd-2966dea8820c: deleted successfully Apr 21 20:57:45 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 0 in 1.119s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_70gs3ctbdevstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:45 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Converted 112.00 MB image at 99.99 MB/s Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 1G Apr 21 20:57:45 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "cinder-quobyte-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Lock "cinder-quobyte-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb9206-9456-4632-b205-ad31affa3919]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 Apr 21 20:57:45 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 1G" returned: 0 in 0.565s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6f85b-afc3-4225-84c8-035dc41d608d]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:45 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" returned: 0 in 0.602s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0 Apr 21 20:57:46 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 0 in 0.610s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:46 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" returned: 0 in 0.529s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Lock "cinder-quobyte-f7a2bdd7-b801-4148-8306-ea7a3a0c27e0" released by "delete_volume" :: held 1.165s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Created reservations ['b9ff0a78-568f-43f2-91c6-f661915af92b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:46 devstack cinder-volume[82005]: WARNING cinder.quota [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-547515333 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-547515333, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Created reservations ['12fb233a-8698-4789-9aef-09979473a1bd', '8c26ae33-cdf2-4d2e-b866-2efa3e9e3a44', '2a28ed1c-15a4-4c59-b3a5-5e6252743f87', 'b3b94988-7a16-4ccd-b4fd-fb69c595c27e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 1 in 0.562s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Downloaded image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume 86e74da4-2575-4277-902d-beb35536bb37 successfully. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f for user 486cb43d16dc4bd99209f8217854a87f is deleted. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Marking volume 86e74da4-2575-4277-902d-beb35536bb37 as bootable. {{(pid=82005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:57:46 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:46 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Copying metadata from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f to 86e74da4-2575-4277-902d-beb35536bb37. {{(pid=82005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Creating volume glance metadata for volume 86e74da4-2575-4277-902d-beb35536bb37 backed by image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275e7a97-0e12-4dda-8624-d861bbc887d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e74da4-2575-4277-902d-beb35536bb37', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ec5b95-20a7-447b-835c-3d73cad49cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:46 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Volume volume-86e74da4-2575-4277-902d-beb35536bb37 (86e74da4-2575-4277-902d-beb35536bb37): created successfully Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ec5b95-20a7-447b-835c-3d73cad49cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (f38cd70d-c450-4d64-bd73-fe4270385ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-62768953-1810-45e6-9c6e-a46c567c783a tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:47 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.489s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:47 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-bdf4c38b-0f4b-48bd-a614-08497108f760 tempest-GroupSnapshotsV319Test-14595453 None] Delete group completed successfully. Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (117f67d8-b2f5-4b83-892d-2c8d05c5676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b280b70-eb20-4e98-a35e-2ac2fada9850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b280b70-eb20-4e98-a35e-2ac2fada9850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-342367539',display_name='tempest-VolumesGetTest-Volume-201862890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:48Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9512f5d-afd8-4b0a-bac5-e5944fe8dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9512f5d-afd8-4b0a-bac5-e5944fe8dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90ae93-1fd4-4313-b0e0-eb94b496011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90ae93-1fd4-4313-b0e0-eb94b496011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd485ddc0-39c2-4585-b4b9-bffb3cd5b9b2', 'volume_name': 'volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56551e7-9e02-4e53-b22e-195213f22375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56551e7-9e02-4e53-b22e-195213f22375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1335d311-8534-483a-9835-f4851de040df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:48 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Volume d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2', 'volume_size': 1} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-342367539',display_name='tempest-VolumesGetTest-Volume-201862890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27ffee8a7d04300a97399c2b95041fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:48Z,use_quota=True,user_id='486cb43d16dc4bd99209f8217854a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Creating volume d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:48 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 1073741824 Apr 21 20:57:48 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:49 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 1073741824" returned: 0 in 0.616s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:49 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 Apr 21 20:57:49 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:49 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2" returned: 0 in 0.531s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1335d311-8534-483a-9835-f4851de040df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c1c619-d347-40d1-a6dd-c0a83bbdbe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:49 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Volume volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 (d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2): created successfully Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c1c619-d347-40d1-a6dd-c0a83bbdbe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Flow 'volume_create_manager' (117f67d8-b2f5-4b83-892d-2c8d05c5676b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:49 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-dee77817-a481-4002-af86-ed4b6a81ac21 tempest-VolumesGetTest-962889553 None] Created volume successfully. Apr 21 20:57:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Lock "cinder-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:50 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ddaf6b-772d-4fa3-bdac-a58d660fa80d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 Apr 21 20:57:50 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2" returned: 0 in 0.540s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2 Apr 21 20:57:51 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2" returned: 0 in 0.510s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2" released by "delete_volume" :: held 1.083s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Created reservations ['347d372d-2d78-4a07-ab06-e2e28c8e6d42', '3e795d9a-2981-42ee-8011-9434431e7bb9', '0d8f9bf5-adb3-4c71-983d-8a55301e5507', '660dd7bd-9482-4165-b60a-4f625bba4b5b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:51 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Flow 'volume_create_manager' (b821b4d8-b014-479a-b13d-e83902b46d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed7c0da-1974-4a7f-be0a-25f8185aa0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed7c0da-1974-4a7f-be0a-25f8185aa0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-851498911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78263a7-7850-4788-b7cb-8025e1417315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c99e624a4c446aa7e0e0601c5e69ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:52Z,use_quota=True,user_id='095804a16dec4eb3a8ea0f0588c84601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f0ff19-3ba2-4b26-9927-f19b213d489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f0ff19-3ba2-4b26-9927-f19b213d489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e5b3ac-192c-4d61-b02b-27b0cdb499d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e5b3ac-192c-4d61-b02b-27b0cdb499d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78263a7-7850-4788-b7cb-8025e1417315', 'volume_name': 'volume-c78263a7-7850-4788-b7cb-8025e1417315', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bd0061-d536-4f08-9065-8d6de3fd1f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bd0061-d536-4f08-9065-8d6de3fd1f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5a3bbf-4328-465f-9cc5-9e8a67b99e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:51 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Volume c78263a7-7850-4788-b7cb-8025e1417315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78263a7-7850-4788-b7cb-8025e1417315', 'volume_size': 1} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-851498911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78263a7-7850-4788-b7cb-8025e1417315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c99e624a4c446aa7e0e0601c5e69ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:52Z,use_quota=True,user_id='095804a16dec4eb3a8ea0f0588c84601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Creating volume c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:51 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 1073741824 Apr 21 20:57:51 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.476s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:52 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3d0a9b13-455a-4665-a955-3e52bf9a3796 tempest-VolumesGetTest-962889553 None] Lock "cinder-d485ddc0-39c2-4585-b4b9-bffb3cd5b9b2-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:52 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 1073741824" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:57:52 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-86e74da4-2575-4277-902d-beb35536bb37-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Lock "cinder-86e74da4-2575-4277-902d-beb35536bb37-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Acquiring lock "cinder-quobyte-86e74da4-2575-4277-902d-beb35536bb37" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-86e74da4-2575-4277-902d-beb35536bb37" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df7503-ebe8-419b-b13c-73e74d759cc1]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 0.468s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5a3bbf-4328-465f-9cc5-9e8a67b99e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78263a7-7850-4788-b7cb-8025e1417315', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f83e05-bfa6-44ae-b431-ff7f9e4fb407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Volume volume-c78263a7-7850-4788-b7cb-8025e1417315 (c78263a7-7850-4788-b7cb-8025e1417315): created successfully Apr 21 20:57:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f83e05-bfa6-44ae-b431-ff7f9e4fb407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Flow 'volume_create_manager' (b821b4d8-b014-479a-b13d-e83902b46d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:53 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:53 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-86aac1d1-f12c-48d1-a1ed-b89698088c1e tempest-VolumesDeleteCascade-1243634591 None] Created volume successfully. Apr 21 20:57:53 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 0 in 0.541s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:53 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 1 in 0.592s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Creating offline snapshot 16cd4060-cd6a-453c-8f7f-6d9835130782 of volume c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef10bf3-2e3c-45a4-8375-25a136b3e954]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37 Apr 21 20:57:54 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:57:54 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-86e74da4-2575-4277-902d-beb35536bb37" returned: 0 in 0.508s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Lock "cinder-quobyte-86e74da4-2575-4277-902d-beb35536bb37" released by "delete_volume" :: held 1.696s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:54 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 0.566s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Created reservations ['05f2893f-32d8-481a-8497-9b426c3f417a', 'e525133e-854f-471e-8523-506087d0f030', 'f8f137e4-4528-40a6-a8c4-124c48cb760c', '7365bc4a-57b5-4955-ba79-baf2934ff58e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 1G Apr 21 20:57:54 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:54 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.513s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Deleted volume successfully. Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-12005a2e-c556-4fca-9fe6-6da3219f8ff6 tempest-VolumesGetTest-962889553 None] Lock "cinder-86e74da4-2575-4277-902d-beb35536bb37-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:55 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Flow 'volume_create_manager' (b547e910-68ef-4791-9e50-552a71b9a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4451c875-010a-4db0-adeb-6c97f9e66212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4451c875-010a-4db0-adeb-6c97f9e66212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1193899111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbffdc6-44d9-4599-a6b2-1027c6a90162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b759f74f69f4dfc8cb1f5d6f8d4da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:55Z,use_quota=True,user_id='f8b0ba632653400ebf05864e26c476e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f026ed-5e13-4daa-b36f-8416c2156873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f026ed-5e13-4daa-b36f-8416c2156873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf42828-bbac-4afa-a6d8-0cb35ed669f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf42828-bbac-4afa-a6d8-0cb35ed669f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbffdc6-44d9-4599-a6b2-1027c6a90162', 'volume_name': 'volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea0b72b-350b-4e2a-8804-c29a9d29f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea0b72b-350b-4e2a-8804-c29a9d29f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c983ab50-88e6-42ad-890d-9882548097f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Volume ddbffdc6-44d9-4599-a6b2-1027c6a90162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162', 'volume_size': 1} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 1G" returned: 0 in 0.847s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:57:55 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.443s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 is being set with open permissions: ugo+rw Apr 21 20:57:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:57:56 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info Apr 21 20:57:56 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info" returned: 0 in 0.409s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info is being set with open permissions: ugo+rw Apr 21 20:57:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info Apr 21 20:57:56 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (79b61f70-40cc-49ce-9674-dff7750b557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac55df8-b218-4c11-b0c2-1c6b5a91d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac55df8-b218-4c11-b0c2-1c6b5a91d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1300959113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded4e59b-51c2-4d80-b004-893300c44dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:57Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a515f96-8ec8-4b01-ba4b-20e5faa8a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a515f96-8ec8-4b01-ba4b-20e5faa8a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5cf050-124e-4975-b56d-28f1adb26b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5cf050-124e-4975-b56d-28f1adb26b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded4e59b-51c2-4d80-b004-893300c44dec', 'volume_name': 'volume-ded4e59b-51c2-4d80-b004-893300c44dec', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9302fbca-d534-45cd-9ae8-40f5131b07d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9302fbca-d534-45cd-9ae8-40f5131b07d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e39af2-da44-4c7d-a8d2-aa27f68a27ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Volume ded4e59b-51c2-4d80-b004-893300c44dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded4e59b-51c2-4d80-b004-893300c44dec', 'volume_size': 1} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (504dd005-1849-452b-9a84-f5e597136e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e009d3af-fd89-4b71-90de-14dd904be7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e009d3af-fd89-4b71-90de-14dd904be7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778939422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:57Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c91b9fb-fe69-42c7-b3d9-fa0b173c7501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c91b9fb-fe69-42c7-b3d9-fa0b173c7501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee37bdab-7503-4751-84aa-82e738d51d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee37bdab-7503-4751-84aa-82e738d51d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1', 'volume_name': 'volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ef62f5-c91d-479f-b667-27a9d8fb722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ef62f5-c91d-479f-b667-27a9d8fb722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bee0d8-fa53-4f14-938c-dc45bd928f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Volume 3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1', 'volume_size': 1} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.info" returned: 0 in 0.536s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1193899111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbffdc6-44d9-4599-a6b2-1027c6a90162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b759f74f69f4dfc8cb1f5d6f8d4da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:55Z,use_quota=True,user_id='f8b0ba632653400ebf05864e26c476e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Creating volume ddbffdc6-44d9-4599-a6b2-1027c6a90162 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:57 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:57 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 1073741824 Apr 21 20:57:57 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8fae7e83-81b0-4313-954f-e3684208ff80 tempest-VolumesDeleteCascade-1243634591 None] Create snapshot completed successfully Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (a0a5b76b-eaf1-46a8-ba0c-6af1d4e24d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee3189f-5830-4fac-b2da-0628e9a074ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee3189f-5830-4fac-b2da-0628e9a074ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765295587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36f2be4-24fe-4e11-b053-d3eac9a8f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:57Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa73d5a-d72a-45ad-ae1b-c283bfb5de7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa73d5a-d72a-45ad-ae1b-c283bfb5de7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa2483f-17fc-4cab-8b28-4073ca14f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa2483f-17fc-4cab-8b28-4073ca14f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36f2be4-24fe-4e11-b053-d3eac9a8f249', 'volume_name': 'volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b48de0-3aca-4757-9e33-3e38678f11bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b48de0-3aca-4757-9e33-3e38678f11bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af2660c-1c70-4a48-a5a6-577cfa353883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Volume f36f2be4-24fe-4e11-b053-d3eac9a8f249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249', 'volume_size': 1} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (586b8060-1ad2-4aaf-ae7e-69c9e6fd76ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdccee0a-9de3-4406-85b4-7682b82436d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdccee0a-9de3-4406-85b4-7682b82436d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-227589990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15a1218-ddeb-4819-a2ad-00caa91609fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:58Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9237db2e-3395-4855-b6fd-0071c075a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9237db2e-3395-4855-b6fd-0071c075a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fc57b6-d1e6-40d2-a84c-5c754ecff077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fc57b6-d1e6-40d2-a84c-5c754ecff077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15a1218-ddeb-4819-a2ad-00caa91609fe', 'volume_name': 'volume-a15a1218-ddeb-4819-a2ad-00caa91609fe', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae88d63-7ed7-4cb7-a7f8-02577e3411a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae88d63-7ed7-4cb7-a7f8-02577e3411a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db031fd1-f6f9-40c0-ac57-13bdc6fabade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Volume a15a1218-ddeb-4819-a2ad-00caa91609fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15a1218-ddeb-4819-a2ad-00caa91609fe', 'volume_size': 1} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (169dbae3-5d81-4799-8429-ae91c87dd328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1239450-f9c6-4981-a5bc-aa39137dd96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1239450-f9c6-4981-a5bc-aa39137dd96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-612738406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19278c-e221-4616-a9da-43b0c1853137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:58Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5508a5eb-238a-4d93-b38a-5f2e92193496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5508a5eb-238a-4d93-b38a-5f2e92193496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f173fb5a-2632-42ef-a214-546cdbff4702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f173fb5a-2632-42ef-a214-546cdbff4702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b19278c-e221-4616-a9da-43b0c1853137', 'volume_name': 'volume-3b19278c-e221-4616-a9da-43b0c1853137', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e474c0-ed20-45ba-a4b5-5b134e99a7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e474c0-ed20-45ba-a4b5-5b134e99a7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8860fa-72ba-4a3c-b532-14d9d44b6512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Volume 3b19278c-e221-4616-a9da-43b0c1853137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b19278c-e221-4616-a9da-43b0c1853137', 'volume_size': 1} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:58 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 1073741824" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 Apr 21 20:57:58 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:58 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162" returned: 0 in 0.453s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.399s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1300959113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded4e59b-51c2-4d80-b004-893300c44dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:57Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Creating volume ded4e59b-51c2-4d80-b004-893300c44dec {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:58 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c983ab50-88e6-42ad-890d-9882548097f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:58 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec 1073741824 Apr 21 20:57:58 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9652ab7-9712-4ea3-a98a-f9353117db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Volume volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 (ddbffdc6-44d9-4599-a6b2-1027c6a90162): created successfully Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9652ab7-9712-4ea3-a98a-f9353117db20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Flow 'volume_create_manager' (b547e910-68ef-4791-9e50-552a71b9a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:58 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-631b89a8-c76b-4818-adef-83266b790ff5 tempest-VolumeQuotasAdminTestJSON-401881115 None] Created volume successfully. Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "cinder-ddbffdc6-44d9-4599-a6b2-1027c6a90162-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "cinder-ddbffdc6-44d9-4599-a6b2-1027c6a90162-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "cinder-quobyte-ddbffdc6-44d9-4599-a6b2-1027c6a90162" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "cinder-quobyte-ddbffdc6-44d9-4599-a6b2-1027c6a90162" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef43a5a-f483-4d3e-8664-e8f38e40a18f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 Apr 21 20:57:58 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec 1073741824" returned: 0 in 0.524s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec Apr 21 20:57:59 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162 Apr 21 20:57:59 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec" returned: 0 in 0.407s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.050s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778939422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:57Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Creating volume 3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:59 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e39af2-da44-4c7d-a8d2-aa27f68a27ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded4e59b-51c2-4d80-b004-893300c44dec', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70862838-b7e2-4694-975b-9da715170d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:59 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 1073741824 Apr 21 20:57:59 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Volume volume-ded4e59b-51c2-4d80-b004-893300c44dec (ded4e59b-51c2-4d80-b004-893300c44dec): created successfully Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70862838-b7e2-4694-975b-9da715170d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (79b61f70-40cc-49ce-9674-dff7750b557e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d90bb06e-f398-4b1d-a536-13db030e96d6 tempest-CreateVolumesFromImageTest-773717622 None] Created volume successfully. Apr 21 20:57:59 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddbffdc6-44d9-4599-a6b2-1027c6a90162" returned: 0 in 0.397s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "cinder-quobyte-ddbffdc6-44d9-4599-a6b2-1027c6a90162" released by "delete_volume" :: held 0.889s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Created reservations ['0eaeaf78-133c-4152-92e0-c2d8d3212700', '4791aac4-5dca-409c-9f2b-03c9d17cc5cc', '18e0cf2d-8783-4326-b2cb-96d8df77ecb2', '3fa8a42f-98c0-44c8-a56e-6bb6d3be8825'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:57:59 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 1073741824" returned: 0 in 0.772s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 Apr 21 20:58:00 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Flow 'volume_create_manager' (15c1db58-0989-4689-bad4-eb523cb4f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15aaf458-e291-4aa0-ba4e-b97e5c783e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15aaf458-e291-4aa0-ba4e-b97e5c783e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-825747883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b06edea-29ac-4493-9f0b-e952b832796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b759f74f69f4dfc8cb1f5d6f8d4da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:00Z,use_quota=True,user_id='f8b0ba632653400ebf05864e26c476e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9767d6fd-4938-4c12-a61f-191b7509ee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9767d6fd-4938-4c12-a61f-191b7509ee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be03d6a-a059-4599-afd6-0171f115a515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be03d6a-a059-4599-afd6-0171f115a515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b06edea-29ac-4493-9f0b-e952b832796b', 'volume_name': 'volume-5b06edea-29ac-4493-9f0b-e952b832796b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc2fd95-24f3-48fd-8e52-ebb8d1578b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc2fd95-24f3-48fd-8e52-ebb8d1578b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d50d4e-b072-449a-b205-5572677c9ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Volume 5b06edea-29ac-4493-9f0b-e952b832796b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b06edea-29ac-4493-9f0b-e952b832796b', 'volume_size': 1} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:00 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.810s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:00 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Deleted volume successfully. Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8d4f8f65-53ab-4253-abdf-f68e357d2d55 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "cinder-ddbffdc6-44d9-4599-a6b2-1027c6a90162-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:00 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765295587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36f2be4-24fe-4e11-b053-d3eac9a8f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:57Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Creating volume f36f2be4-24fe-4e11-b053-d3eac9a8f249 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:00 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bee0d8-fa53-4f14-938c-dc45bd928f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1dc0ee-12ad-4e2e-9a99-3e3be6ad533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:00 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 1073741824 Apr 21 20:58:00 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Volume volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 (3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1): created successfully Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1dc0ee-12ad-4e2e-9a99-3e3be6ad533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (504dd005-1849-452b-9a84-f5e597136e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:00 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fc564919-76ee-4360-9a5b-dd51f21a13ca tempest-CreateVolumesFromImageTest-773717622 None] Created volume successfully. Apr 21 20:58:01 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 1073741824" returned: 0 in 0.561s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 Apr 21 20:58:01 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249" returned: 0 in 0.415s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.953s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-227589990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15a1218-ddeb-4819-a2ad-00caa91609fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:58Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Creating volume a15a1218-ddeb-4819-a2ad-00caa91609fe {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:01 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af2660c-1c70-4a48-a5a6-577cfa353883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9434e7-af69-484d-96be-6bc4996fa9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:01 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe 1073741824 Apr 21 20:58:01 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Volume volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 (f36f2be4-24fe-4e11-b053-d3eac9a8f249): created successfully Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9434e7-af69-484d-96be-6bc4996fa9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (a0a5b76b-eaf1-46a8-ba0c-6af1d4e24d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5aecec7b-8546-4727-8fbc-bada8ac2df9c tempest-CreateVolumesFromImageTest-773717622 None] Created volume successfully. Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-75486a12-6ede-43b2-b6b4-ba5b0de60d7d tempest-VolumesActionsTest-1166073924 None] Acquiring lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8" by "attach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-75486a12-6ede-43b2-b6b4-ba5b0de60d7d tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8" acquired by "attach_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-75486a12-6ede-43b2-b6b4-ba5b0de60d7d tempest-VolumesActionsTest-1166073924 None] Attaching volume e7750832-6f5b-4407-b2cc-7e5e599980e8 to instance af059728-0437-46e0-aafc-cae2629a79c5 at mountpoint /dev/vdb on host None. Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-75486a12-6ede-43b2-b6b4-ba5b0de60d7d tempest-VolumesActionsTest-1166073924 None] Attach volume completed successfully. Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-75486a12-6ede-43b2-b6b4-ba5b0de60d7d tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8" released by "attach_volume" :: held 0.075s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:02 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe 1073741824" returned: 0 in 0.543s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe Apr 21 20:58:02 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe" returned: 0 in 0.428s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.763s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-612738406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19278c-e221-4616-a9da-43b0c1853137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1564e25860eb4374a44d5a879753918d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:58Z,use_quota=True,user_id='71047098c6894c82b5260fbe8a79831a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Creating volume 3b19278c-e221-4616-a9da-43b0c1853137 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db031fd1-f6f9-40c0-ac57-13bdc6fabade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15a1218-ddeb-4819-a2ad-00caa91609fe', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:02 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 1073741824 Apr 21 20:58:02 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86218aa-8821-4b4b-b8fd-b7949cc4c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=230,cinder:SELECT=197,cinder:DELETE=13,cinder:INSERT=69 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ec0e2bb6-9390-4adb-9fa9-fc204a5ae4bc tempest-VolumesActionsTest-1166073924 None] Acquiring lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-detach_volume" by "detach_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Volume volume-a15a1218-ddeb-4819-a2ad-00caa91609fe (a15a1218-ddeb-4819-a2ad-00caa91609fe): created successfully Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86218aa-8821-4b4b-b8fd-b7949cc4c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (586b8060-1ad2-4aaf-ae7e-69c9e6fd76ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2991cafe-c026-4e89-9c45-da2b03226d07 tempest-CreateVolumesFromImageTest-773717622 None] Created volume successfully. Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ec0e2bb6-9390-4adb-9fa9-fc204a5ae4bc tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ec0e2bb6-9390-4adb-9fa9-fc204a5ae4bc tempest-VolumesActionsTest-1166073924 None] Detaching volume e7750832-6f5b-4407-b2cc-7e5e599980e8 from instance af059728-0437-46e0-aafc-cae2629a79c5. Apr 21 20:58:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ec0e2bb6-9390-4adb-9fa9-fc204a5ae4bc tempest-VolumesActionsTest-1166073924 None] Detach volume completed successfully. Apr 21 20:58:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ec0e2bb6-9390-4adb-9fa9-fc204a5ae4bc tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:03 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 1073741824" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 Apr 21 20:58:03 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137" returned: 0 in 0.587s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.521s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Creating offline snapshot c3172aef-6eb3-4483-bf31-5a6c7186d2a2 of volume c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8860fa-72ba-4a3c-b532-14d9d44b6512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b19278c-e221-4616-a9da-43b0c1853137', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04571064-ebf0-4c4d-a7a5-ce2fadc9e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc9a32-afed-4da5-9471-2028a44d70bc]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Volume volume-3b19278c-e221-4616-a9da-43b0c1853137 (3b19278c-e221-4616-a9da-43b0c1853137): created successfully Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04571064-ebf0-4c4d-a7a5-ce2fadc9e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Flow 'volume_create_manager' (169dbae3-5d81-4799-8429-ae91c87dd328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-61f58b84-480d-4f63-af6b-5091234811a6 tempest-CreateVolumesFromImageTest-773717622 None] Created volume successfully. Apr 21 20:58:04 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:58:04 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.514s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78263a7-7850-4788-b7cb-8025e1417315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 1G Apr 21 20:58:04 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-3b19278c-e221-4616-a9da-43b0c1853137-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-3b19278c-e221-4616-a9da-43b0c1853137-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-quobyte-3b19278c-e221-4616-a9da-43b0c1853137" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-3b19278c-e221-4616-a9da-43b0c1853137" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f068b-cece-4072-a508-75f5eca7acae]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 Apr 21 20:58:04 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 1G" returned: 0 in 0.626s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 Apr 21 20:58:05 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137" returned: 0 in 0.575s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137 Apr 21 20:58:05 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 is being set with open permissions: ugo+rw Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 Apr 21 20:58:05 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3b19278c-e221-4616-a9da-43b0c1853137" returned: 0 in 0.446s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-3b19278c-e221-4616-a9da-43b0c1853137" released by "delete_volume" :: held 1.097s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Created reservations ['3a9481fb-01f0-4cbe-8df2-9c50fac7ece9', '41aff7e1-dc08-43c5-9870-cdc55d270518', '28e5b0dc-8f44-4a58-a25b-d740d5f4f872', 'b25778a2-391d-4c22-a87e-0e01160f5585'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:05 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2" returned: 0 in 0.425s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.476s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-825747883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b06edea-29ac-4493-9f0b-e952b832796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b759f74f69f4dfc8cb1f5d6f8d4da4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:00Z,use_quota=True,user_id='f8b0ba632653400ebf05864e26c476e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Creating volume 5b06edea-29ac-4493-9f0b-e952b832796b {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:05 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e4fa22c9-7769-40a3-85fe-cb09c58a224b tempest-VolumesDeleteCascade-1243634591 None] Create snapshot completed successfully Apr 21 20:58:06 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b 1073741824 Apr 21 20:58:06 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.466s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Deleted volume successfully. Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-76b88bfe-246e-4a6d-89d4-770551b3eab0 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-3b19278c-e221-4616-a9da-43b0c1853137-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:06 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b 1073741824" returned: 0 in 0.560s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b Apr 21 20:58:06 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-c78263a7-7850-4788-b7cb-8025e1417315-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c78263a7-7850-4788-b7cb-8025e1417315-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Performing cascade delete. {{(pid=82005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-16cd4060-cd6a-453c-8f7f-6d9835130782-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-16cd4060-cd6a-453c-8f7f-6d9835130782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-16cd4060-cd6a-453c-8f7f-6d9835130782" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-16cd4060-cd6a-453c-8f7f-6d9835130782" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Deleting offline snapshot 16cd4060-cd6a-453c-8f7f-6d9835130782 of volume c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] snapshot_file for this snap is: volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-a15a1218-ddeb-4819-a2ad-00caa91609fe-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[399473e2-4a78-40fa-85d7-b7cbf034c25b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-a15a1218-ddeb-4819-a2ad-00caa91609fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-quobyte-a15a1218-ddeb-4819-a2ad-00caa91609fe" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-a15a1218-ddeb-4819-a2ad-00caa91609fe" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:58:06 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f574c-01d9-4175-b4b5-7c4c1859bf98]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe Apr 21 20:58:06 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:07 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b" returned: 0 in 0.452s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d50d4e-b072-449a-b205-5572677c9ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b06edea-29ac-4493-9f0b-e952b832796b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41d84d0-05cd-4da6-ba56-150b8584b066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:07 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Volume volume-5b06edea-29ac-4493-9f0b-e952b832796b (5b06edea-29ac-4493-9f0b-e952b832796b): created successfully Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41d84d0-05cd-4da6-ba56-150b8584b066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Flow 'volume_create_manager' (15c1db58-0989-4689-bad4-eb523cb4f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-51984dab-9611-4d57-9713-aaff9913cf69 tempest-VolumeQuotasAdminTestJSON-401881115 None] Created volume successfully. Apr 21 20:58:07 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.470s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78263a7-7850-4788-b7cb-8025e1417315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86abf59-3cdf-4c17-8f3b-668976775544]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:58:07 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:07 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe" returned: 0 in 0.490s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe Apr 21 20:58:07 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:07 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a15a1218-ddeb-4819-a2ad-00caa91609fe" returned: 0 in 0.444s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-a15a1218-ddeb-4819-a2ad-00caa91609fe" released by "delete_volume" :: held 0.955s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:07 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 0.568s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de2feb-6262-4ba0-b3d2-737077746865]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Created reservations ['199b666e-d48a-4a17-8f10-2efe90876edc', '5e0545af-10be-4e70-84f2-70d622d131ad', 'b908a2ed-24f9-40b5-82fa-4f6b835cce5e', '9c10e361-f882-4176-a141-a3392e1971a0'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 Apr 21 20:58:08 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:08 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-836ac300-2064-4f84-b88f-fcb901ce7ab5 tempest-VolumeQuotasAdminTestJSON-1942815172 None] Transfer volume completed successfully. Apr 21 20:58:08 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.423s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Deleted volume successfully. Apr 21 20:58:08 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-defed4e5-2193-41c3-8aeb-389399f4840a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-a15a1218-ddeb-4819-a2ad-00caa91609fe-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2" returned: 0 in 0.507s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78263a7-7850-4788-b7cb-8025e1417315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[605fceeb-e8ea-4a84-a25f-7de7da7cdf92]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:58:08 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Acquiring lock "cinder-5b06edea-29ac-4493-9f0b-e952b832796b-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Lock "cinder-5b06edea-29ac-4493-9f0b-e952b832796b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Acquiring lock "cinder-quobyte-5b06edea-29ac-4493-9f0b-e952b832796b" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Lock "cinder-quobyte-5b06edea-29ac-4493-9f0b-e952b832796b" acquired by "delete_volume" :: waited 0.023s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36bcd27-616a-4400-8843-94c55de689fa]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78263a7-7850-4788-b7cb-8025e1417315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96663a-1dae-49b2-8949-2ce0d829e065]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b Apr 21 20:58:08 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-f36f2be4-24fe-4e11-b053-d3eac9a8f249-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-f36f2be4-24fe-4e11-b053-d3eac9a8f249-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:09 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:58:09 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-quobyte-f36f2be4-24fe-4e11-b053-d3eac9a8f249" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-f36f2be4-24fe-4e11-b053-d3eac9a8f249" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc0b08-1328-4696-8704-28c42cd35e1a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 Apr 21 20:58:09 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b Apr 21 20:58:09 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 0.514s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:58:09 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249 Apr 21 20:58:09 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b06edea-29ac-4493-9f0b-e952b832796b" returned: 0 in 0.434s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Lock "cinder-quobyte-5b06edea-29ac-4493-9f0b-e952b832796b" released by "delete_volume" :: held 0.982s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Created reservations ['56b8bc1c-e176-48ba-88b2-86a9da0e92ec', '6038baea-559b-4730-ada2-f69628e423b6', 'a7212b64-8318-4388-b56c-f9e23ca4e7a2', 'c174b7a6-0f08-430a-bdae-59bf661210d9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:09 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782 Apr 21 20:58:09 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:09 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f36f2be4-24fe-4e11-b053-d3eac9a8f249" returned: 0 in 0.459s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-f36f2be4-24fe-4e11-b053-d3eac9a8f249" released by "delete_volume" :: held 0.968s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Created reservations ['9e2aa033-a7a3-42c9-8989-731a9d084ba5', '26d7c634-7ad0-4595-ae8f-763f018b0e76', 'e125b976-02de-4887-ac37-c2e370ee9d72', 'ec1f958c-3a5f-4148-90b1-dadcfc8344a3'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:10 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:10 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.497s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.16cd4060-cd6a-453c-8f7f-6d9835130782" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 -F qcow2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Deleted volume successfully. Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-468a2e3d-4a51-4b6c-a75c-24ed081950b5 tempest-VolumeQuotasAdminTestJSON-227143116 None] Lock "cinder-5b06edea-29ac-4493-9f0b-e952b832796b-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:10 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 -F qcow2 Apr 21 20:58:10 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Deleted volume successfully. Apr 21 20:58:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-3a4f5383-d1c2-42ca-9bcc-beee14320754 tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-f36f2be4-24fe-4e11-b053-d3eac9a8f249-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:11 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78263a7-7850-4788-b7cb-8025e1417315 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 -F qcow2" returned: 0 in 0.581s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-16cd4060-cd6a-453c-8f7f-6d9835130782" released by "_delete_snapshot" :: held 4.246s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" released by "delete_snapshot" :: held 4.263s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Created reservations ['ead110bf-9f9b-4fad-9aa5-5a280a3134c2', '86a861a5-1293-4dda-b5dc-029956b2046a', '6b31979c-e3ff-44fc-94ec-20258395e70a', '1d0d4b79-2c67-40d7-a8e9-0c482e522192'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:11 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Delete snapshot completed successfully. Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-16cd4060-cd6a-453c-8f7f-6d9835130782-delete_snapshot" released by "delete_snapshot" :: held 4.378s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-c3172aef-6eb3-4483-bf31-5a6c7186d2a2-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c3172aef-6eb3-4483-bf31-5a6c7186d2a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c3172aef-6eb3-4483-bf31-5a6c7186d2a2" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c3172aef-6eb3-4483-bf31-5a6c7186d2a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Deleting offline snapshot c3172aef-6eb3-4483-bf31-5a6c7186d2a2 of volume c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] snapshot_file for this snap is: volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[461772ad-770b-4cc4-a6ad-0c260997480d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-quobyte-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24955aa-c9d7-452d-a35a-1482450e9019]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:11 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 Apr 21 20:58:11 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:11 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 Apr 21 20:58:11 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[736fedb6-f25c-40d6-8148-0b3ab47d829f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:11 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1" returned: 0 in 0.564s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:11 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2" returned: 0 in 0.613s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:11 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78263a7-7850-4788-b7cb-8025e1417315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:11 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eec1451-46e2-4a45-b3d2-5fc9f3b38647]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:11 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1 Apr 21 20:58:11 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:11 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:58:11 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.559s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[663edc1d-44a7-4a9f-9ec2-1e33ba236a7d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1" returned: 0 in 0.515s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1" released by "delete_volume" :: held 1.102s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:12 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:12 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Created reservations ['11c5cad1-83bf-4cfa-be50-8ea01c1efe2a', '2610946c-126e-47df-a79c-63df50c36e82', '3e73c658-86fd-47f4-a11f-6f9dfb2d9850', '58c9db21-a634-4a90-9ffa-8a06db080d7f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 0.606s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:12 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 Apr 21 20:58:12 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.598s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.fbd13454-e7b6-4376-80dd-cfafac859d72vc8eomnl.img {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.fbd13454-e7b6-4376-80dd-cfafac859d72vc8eomnl.img Apr 21 20:58:12 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.514s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:12 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Deleted volume successfully. Apr 21 20:58:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4b8a96b9-7fc9-4082-abf3-ed316d56c00a tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-3c3bd03a-00bb-429d-a4d0-bf755a4eb9d1-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2" returned: 0 in 0.561s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:13 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2 Apr 21 20:58:13 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-ded4e59b-51c2-4d80-b004-893300c44dec-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-ded4e59b-51c2-4d80-b004-893300c44dec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:13 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "cinder-quobyte-ded4e59b-51c2-4d80-b004-893300c44dec" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315.c3172aef-6eb3-4483-bf31-5a6c7186d2a2" returned: 0 in 0.693s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-ded4e59b-51c2-4d80-b004-893300c44dec" acquired by "delete_volume" :: waited 0.047s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c3172aef-6eb3-4483-bf31-5a6c7186d2a2" released by "_delete_snapshot" :: held 2.585s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" released by "delete_snapshot" :: held 2.607s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8161c-806c-4273-b535-0108d53de6ff]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Created reservations ['948ce5c4-3cd8-44fa-8ee6-11e72663aa29', '5fb06b66-fd07-4ac4-a134-6457b2aef8db', '9d19ebf7-dc23-4d71-a732-c0924ba77e5e', 'fb0e44c3-0010-4779-b806-26472e3b1dd5'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:13 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Delete snapshot completed successfully. Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c3172aef-6eb3-4483-bf31-5a6c7186d2a2-delete_snapshot" released by "delete_snapshot" :: held 2.833s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Snapshots deleted, issuing volume delete {{(pid=82005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:58:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:14 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9399fd5a-4ea5-4677-98a4-b49683fa6b96]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:14 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec Apr 21 20:58:14 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:14 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:58:14 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.fbd13454-e7b6-4376-80dd-cfafac859d72vc8eomnl.img" returned: 0 in 2.197s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec" returned: 0 in 1.285s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c9decf-a234-4e64-a405-5c2c867b9e2b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec Apr 21 20:58:15 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:15 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 1.169s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315 Apr 21 20:58:15 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ded4e59b-51c2-4d80-b004-893300c44dec" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-quobyte-ded4e59b-51c2-4d80-b004-893300c44dec" released by "delete_volume" :: held 1.830s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Created reservations ['9fb583d5-46b1-4edb-8234-1eb36d0705b2', 'a3ab7978-b3af-41e1-9fd8-b6bb6afff5d2', 'f57e3f6d-4092-4294-a760-ff7ba20772b7', 'ab65acbd-63cc-4020-94d9-204486197d60'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:15 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c78263a7-7850-4788-b7cb-8025e1417315" returned: 0 in 0.529s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c78263a7-7850-4788-b7cb-8025e1417315" released by "delete_volume" :: held 1.761s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.678s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.fbd13454-e7b6-4376-80dd-cfafac859d72vc8eomnl.img {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:15 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Converted 1024.00 MB image at 465.78 MB/s Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] fbd13454-e7b6-4376-80dd-cfafac859d72 was raw, no need to convert to raw {{(pid=82005) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Created reservations ['ddea6fa5-221d-484a-b1c6-261065f0fe5f', 'df03c464-133e-4588-b3b1-cb6b1d434281', '1874e3a4-3751-438f-bbcb-c51833dc8fc7', '3a490f8e-5b9a-419c-8632-9358093fdf2a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:16 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:16 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Flow 'volume_create_manager' (16c4b360-4d1e-405f-aa49-cfed7c505d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33689e60-f8aa-47fd-96b0-7d2289512fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33689e60-f8aa-47fd-96b0-7d2289512fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-33261756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857b345b-4633-443c-b4b2-309f0347e4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabccb5b87774d1191b174705282483a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:16Z,use_quota=True,user_id='8a583b4c397d4f31a7b768d2dd905904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0731e0c5-a698-4908-9938-507e7b77a831),volume_type_id=0731e0c5-a698-4908-9938-507e7b77a831)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e12d99a-23fd-4c7a-a493-5c7e6ff87a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e12d99a-23fd-4c7a-a493-5c7e6ff87a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e38561-403d-4208-a264-8f02c6777267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e38561-403d-4208-a264-8f02c6777267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857b345b-4633-443c-b4b2-309f0347e4cf', 'volume_name': 'volume-857b345b-4633-443c-b4b2-309f0347e4cf', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30f691e-0218-4f79-86da-6a4630b1a908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30f691e-0218-4f79-86da-6a4630b1a908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195c491d-1874-4370-b0fa-6f3b918bb3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Volume 857b345b-4633-443c-b4b2-309f0347e4cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857b345b-4633-443c-b4b2-309f0347e4cf', 'volume_size': 1} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.518s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:16 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Deleted volume successfully. Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b77d86ea-332b-4e01-a2d9-d74b0389765b tempest-CreateVolumesFromImageTest-773717622 None] Lock "cinder-ded4e59b-51c2-4d80-b004-893300c44dec-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:16 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.538s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:16 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Deleted volume successfully. Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b91b3674-b0fe-42fe-9d2b-8a6b92fcbe52 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c78263a7-7850-4788-b7cb-8025e1417315-delete_volume" released by "delete_volume" :: held 9.831s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Flow 'volume_create_manager' (9e75f617-5ddd-4437-9072-59b92c45122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498a1ba9-7f46-4874-9fa7-f55508d39c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498a1ba9-7f46-4874-9fa7-f55508d39c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1243584103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6eda96f-a4de-4605-b2db-3a809fd6b097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c99e624a4c446aa7e0e0601c5e69ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:17Z,use_quota=True,user_id='095804a16dec4eb3a8ea0f0588c84601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0061f1-8ad2-4686-a7bc-e4abaf538670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0061f1-8ad2-4686-a7bc-e4abaf538670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42419e4-2572-44f5-8d81-b2846659f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42419e4-2572-44f5-8d81-b2846659f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6eda96f-a4de-4605-b2db-3a809fd6b097', 'volume_name': 'volume-c6eda96f-a4de-4605-b2db-3a809fd6b097', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c146a4-dcff-4165-8948-ff5d598ed3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c146a4-dcff-4165-8948-ff5d598ed3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95768e9b-e0f6-47b4-8f25-d7dca19b21db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Volume c6eda96f-a4de-4605-b2db-3a809fd6b097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6eda96f-a4de-4605-b2db-3a809fd6b097', 'volume_size': 1} Apr 21 20:58:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.889s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Uploaded volume to glance image-id: fbd13454-e7b6-4376-80dd-cfafac859d72. {{(pid=82005) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.422s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-33261756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857b345b-4633-443c-b4b2-309f0347e4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabccb5b87774d1191b174705282483a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:16Z,use_quota=True,user_id='8a583b4c397d4f31a7b768d2dd905904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0731e0c5-a698-4908-9938-507e7b77a831),volume_type_id=0731e0c5-a698-4908-9938-507e7b77a831)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Creating volume 857b345b-4633-443c-b4b2-309f0347e4cf {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:25 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:25 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf 1073741824 Apr 21 20:58:25 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-96f74ec2-96b3-404a-af60-e5f9f86fa6b8 tempest-VolumesActionsTest-1166073924 None] Copy volume to image completed successfully. Apr 21 20:58:26 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf 1073741824" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:26 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf Apr 21 20:58:26 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:26 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.772s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1243584103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6eda96f-a4de-4605-b2db-3a809fd6b097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c99e624a4c446aa7e0e0601c5e69ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:17Z,use_quota=True,user_id='095804a16dec4eb3a8ea0f0588c84601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Creating volume c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:26 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195c491d-1874-4370-b0fa-6f3b918bb3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857b345b-4633-443c-b4b2-309f0347e4cf', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe67447-5998-4630-b48c-d22ec2788908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:26 devstack sudo[87536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 1073741824 Apr 21 20:58:26 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:26 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Volume volume-857b345b-4633-443c-b4b2-309f0347e4cf (857b345b-4633-443c-b4b2-309f0347e4cf): created successfully Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe67447-5998-4630-b48c-d22ec2788908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Flow 'volume_create_manager' (16c4b360-4d1e-405f-aa49-cfed7c505d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:26 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-206d8f6b-e62f-4fa4-b866-c29976e4774b tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Created volume successfully. Apr 21 20:58:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:27 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 1073741824" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:27 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:27 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:27 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.405s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.807s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c0eb2-6536-49dd-ba53-2bd43300c067]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95768e9b-e0f6-47b4-8f25-d7dca19b21db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6eda96f-a4de-4605-b2db-3a809fd6b097', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c53392-1611-494d-83e1-e2427cffed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Volume volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 (c6eda96f-a4de-4605-b2db-3a809fd6b097): created successfully Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c53392-1611-494d-83e1-e2427cffed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Flow 'volume_create_manager' (9e75f617-5ddd-4437-9072-59b92c45122b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d7ec9d89-0b12-449a-b783-e8d1157e8b5e tempest-VolumesDeleteCascade-1243634591 None] Created volume successfully. Apr 21 20:58:27 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:27 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:27 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:27 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:28 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.506s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac6119-90c7-482b-85c4-1efd18a818bb]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:28 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:28 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:28 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.399s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:28 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d1da9e90-cc0d-4ae4-b848-daa06e47c707 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Retype volume completed successfully. Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:28 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:28 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img Apr 21 20:58:28 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Acquiring lock "cinder-857b345b-4633-443c-b4b2-309f0347e4cf-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "cinder-857b345b-4633-443c-b4b2-309f0347e4cf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Acquiring lock "cinder-quobyte-857b345b-4633-443c-b4b2-309f0347e4cf" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:29 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "cinder-quobyte-857b345b-4633-443c-b4b2-309f0347e4cf" acquired by "delete_volume" :: waited 0.033s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:29 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d38eec7-3179-44c4-bbde-8c92ecc3b377]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:29 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf Apr 21 20:58:29 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:30 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=199,cinder:SELECT=170,cinder:INSERT=57,cinder:DELETE=16 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:30 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf" returned: 0 in 1.144s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:30 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf Apr 21 20:58:30 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:30 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img" returned: 0 in 2.253s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:30 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b496d-57cf-4083-88ad-cf7c36d26aab]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:30 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:30 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:31 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-857b345b-4633-443c-b4b2-309f0347e4cf" returned: 0 in 0.483s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "cinder-quobyte-857b345b-4633-443c-b4b2-309f0347e4cf" released by "delete_volume" :: held 1.672s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:31 devstack cinder-volume[82005]: WARNING cinder.quota [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:31 devstack cinder-volume[82005]: WARNING cinder.quota [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Created reservations ['290ba950-ca83-4910-9e44-2812ada870b7', 'c8afc8fd-5c7f-430a-94eb-c67ed388c9ad', 'dda2bd1b-b558-40be-b1d7-ecf58444c783', 'e628fb8f-5c03-4d0e-b0eb-6ebbd0200770'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:31 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:31 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:31 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.567s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:31 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Converted 1024.00 MB image at 454.32 MB/s Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] d0f1b9b5-c8ea-4631-ad07-0a18b9c13288 was raw, converting to qcow2 {{(pid=82005) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f39d0-1e3c-47a2-a039-ee2d449e8ff6]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:31 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img Apr 21 20:58:31 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:31 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:31 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Deleted volume successfully. Apr 21 20:58:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ae0645ca-2f73-48ab-a41f-3cc509e81914 tempest-VolumeRetypeWithoutMigrationTest-370402919 None] Lock "cinder-857b345b-4633-443c-b4b2-309f0347e4cf-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:32 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img" returned: 0 in 0.601s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:32 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img Apr 21 20:58:32 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:32 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img" returned: 1 in 0.513s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img /opt/stack/data/cinder/conversion/vol_upload_zod8guej {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:32 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img /opt/stack/data/cinder/conversion/vol_upload_zod8guej Apr 21 20:58:32 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:33 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img /opt/stack/data/cinder/conversion/vol_upload_zod8guej" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:33 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Image conversion details: src /opt/stack/data/cinder/conversion/e7750832-6f5b-4407-b2cc-7e5e599980e8.temp_image.d0f1b9b5-c8ea-4631-ad07-0a18b9c13288pqxmqfi8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zod8guej {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:33 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 21 20:58:33 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd718c-3ca0-4579-852d-947dcea48b9b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zod8guej {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:33 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zod8guej Apr 21 20:58:33 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:33 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zod8guej" returned: 0 in 0.535s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.965s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Uploaded volume to glance image-id: d0f1b9b5-c8ea-4631-ad07-0a18b9c13288. {{(pid=82005) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 20:58:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.048s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-502f06f9-f54f-411e-af38-691487a892e7 tempest-VolumesActionsTest-1166073924 None] Copy volume to image completed successfully. Apr 21 20:58:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Creating offline snapshot c748ddd3-9ba9-4f19-b97b-861fcf64324f of volume c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ab0a5-78d1-4e0e-96a6-adbed49c44cb]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:34 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:34 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.578s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f 1G Apr 21 20:58:35 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "cinder-quobyte-e7750832-6f5b-4407-b2cc-7e5e599980e8" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Lock "cinder-quobyte-e7750832-6f5b-4407-b2cc-7e5e599980e8" acquired by "delete_volume" :: waited 0.023s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b2ebc-573d-47e3-b602-799c7a2e3ef6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:35 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f 1G" returned: 0 in 0.648s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f Apr 21 20:58:35 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Flow 'volume_create_manager' (2cb76165-4e09-4f77-acda-65b26c7d768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:36 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669eba24-9dc1-40a2-811f-2ff9a94dbbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.613s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8 Apr 21 20:58:36 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669eba24-9dc1-40a2-811f-2ff9a94dbbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1530603329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ec0076-630d-4961-9068-ab6045dff68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062075535694c8fbea3e4615ee8ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:36Z,use_quota=True,user_id='f3f052b709894347908adf967666f391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc3ba03-46dd-4819-b800-550cb6c9df9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc3ba03-46dd-4819-b800-550cb6c9df9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53463efd-0b43-42c5-81ba-5f6bf81a4fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.image.glance [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Creating Keystone auth plugin from conf {{(pid=82005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:58:36 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f is being set with open permissions: ugo+rw Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f Apr 21 20:58:36 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:36 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53463efd-0b43-42c5-81ba-5f6bf81a4fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62ec0076-630d-4961-9068-ab6045dff68a', 'volume_name': 'volume-62ec0076-630d-4961-9068-ab6045dff68a', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3c4965-48d8-4b2b-bb86-cb5b127b7ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3c4965-48d8-4b2b-bb86-cb5b127b7ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4c094-db27-4b1d-bafd-b95d35b56524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:36 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Volume 62ec0076-630d-4961-9068-ab6045dff68a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62ec0076-630d-4961-9068-ab6045dff68a', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Trying to clone 62ec0076-630d-4961-9068-ab6045dff68a from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]). {{(pid=82005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:58:36 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458401b-d69a-4524-98dc-af537e3d4282]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e7750832-6f5b-4407-b2cc-7e5e599980e8" returned: 0 in 0.477s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Lock "cinder-quobyte-e7750832-6f5b-4407-b2cc-7e5e599980e8" released by "delete_volume" :: held 1.118s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Created reservations ['581df59b-adaf-48a0-82bc-b5a9f237d1c6', 'c67daf36-6e89-4fde-8da4-c1ab78367687', 'b77a75ef-8477-4688-bba2-8cfa8b5c4494', 'cbc87091-7a1a-451b-9813-bd41e44f64d8'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:36 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD Apr 21 20:58:36 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f" returned: 0 in 0.478s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:36 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info Apr 21 20:58:36 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.523s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:37 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:37 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Deleted volume successfully. Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f is fetched for user f3f052b709894347908adf967666f391. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4335ec9e-dd57-4b22-bbc0-a6d20ac20783 tempest-VolumesActionsTest-1166073924 None] Lock "cinder-e7750832-6f5b-4407-b2cc-7e5e599980e8-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e71fcdc-991f-4112-be4e-83e936db0e5d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info is being set with open permissions: ugo+rw Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info Apr 21 20:58:37 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:37 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD Apr 21 20:58:37 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:37 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.info" returned: 0 in 0.446s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1530603329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ec0076-630d-4961-9068-ab6045dff68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0062075535694c8fbea3e4615ee8ef36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:36Z,use_quota=True,user_id='f3f052b709894347908adf967666f391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Creating volume 62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:37 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-963af9ad-790b-4027-b6d4-e5f0778ee036 tempest-VolumesDeleteCascade-1243634591 None] Create snapshot completed successfully Apr 21 20:58:37 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a 1073741824 Apr 21 20:58:37 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a 1073741824" returned: 0 in 0.524s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:38 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:38 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 0 in 0.452s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Attempting download of 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume 62ec0076-630d-4961-9068-ab6045dff68a. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fdbede-ea12-43b9-9677-6a62d640d14e]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:38 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0 Apr 21 20:58:38 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Flow 'volume_create_manager' (caea325d-f44f-4060-aeec-7ed40a0d6496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3366f5b7-2700-445f-97f6-7f90640bfe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3366f5b7-2700-445f-97f6-7f90640bfe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-604753141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4597342a-e41d-4837-a196-b7e6ca03e451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c99e624a4c446aa7e0e0601c5e69ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c748ddd3-9ba9-4f19-b97b-861fcf64324f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:39Z,use_quota=True,user_id='095804a16dec4eb3a8ea0f0588c84601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f64f1b5-c543-4cf3-bbe2-963a6b1b44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f64f1b5-c543-4cf3-bbe2-963a6b1b44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330855c1-a9ff-468a-963d-5987b96b2023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330855c1-a9ff-468a-963d-5987b96b2023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4597342a-e41d-4837-a196-b7e6ca03e451', 'volume_name': 'volume-4597342a-e41d-4837-a196-b7e6ca03e451', 'volume_size': 1, 'snapshot_id': 'c748ddd3-9ba9-4f19-b97b-861fcf64324f'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7443395-5685-4cce-bbc8-c44767d06d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7443395-5685-4cce-bbc8-c44767d06d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0349c483-6500-4169-896d-175f5d19688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:39 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Volume 4597342a-e41d-4837-a196-b7e6ca03e451: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4597342a-e41d-4837-a196-b7e6ca03e451', 'volume_size': 1, 'snapshot_id': 'c748ddd3-9ba9-4f19-b97b-861fcf64324f'} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c748ddd3-9ba9-4f19-b97b-861fcf64324f-4597342a-e41d-4837-a196-b7e6ca03e451" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c748ddd3-9ba9-4f19-b97b-861fcf64324f-4597342a-e41d-4837-a196-b7e6ca03e451" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Creating volume 4597342a-e41d-4837-a196-b7e6ca03e451 from snapshot c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-4597342a-e41d-4837-a196-b7e6ca03e451" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-4597342a-e41d-4837-a196-b7e6ca03e451" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] snapshot: c748ddd3-9ba9-4f19-b97b-861fcf64324f, volume: 4597342a-e41d-4837-a196-b7e6ca03e451, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bc276-8175-4772-b490-4777a88d397d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f Apr 21 20:58:39 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0" returned: 0 in 0.592s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0 Apr 21 20:58:39 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f" returned: 0 in 0.601s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6eda96f-a4de-4605-b2db-3a809fd6b097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f377814b-cd97-4fd2-a90d-274bd1666a8d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0" returned: 1 in 0.540s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_4lowqci0' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcdacf5-a15f-40e0-bfe5-536c5f33a66a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:39 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD Apr 21 20:58:39 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:40 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:40 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f was qcow2, converting to raw {{(pid=82005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:58:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:40 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:40 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:40 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.625s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:40 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:58:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:40 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 Apr 21 20:58:40 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:41 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 0 in 1.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:41 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_s11howkwdevstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:41 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Converted 112.00 MB image at 76.50 MB/s Apr 21 20:58:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:41 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a 1G Apr 21 20:58:41 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Flow 'volume_create_manager' (a9202977-71bf-4246-b6d5-a69fca1f08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bed42fd-f4a3-4bea-89d3-ecd59917869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bed42fd-f4a3-4bea-89d3-ecd59917869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1029338185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9be31fb-982a-4f54-b161-0aae76d7e1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a48b2aaefa945288a0086ccd3fd78c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:43Z,use_quota=True,user_id='c30228b4637549cda39bd9e24a5c285e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:42 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:42 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32165d62-2fb7-43f2-b84f-2e2c1a82d11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32165d62-2fb7-43f2-b84f-2e2c1a82d11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8da76f-b9ca-4db7-9681-95024d6e5603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8da76f-b9ca-4db7-9681-95024d6e5603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9be31fb-982a-4f54-b161-0aae76d7e1ca', 'volume_name': 'volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca', 'volume_size': 2}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b394dcf-d7a0-4c54-a43a-77dfd2fee007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b394dcf-d7a0-4c54-a43a-77dfd2fee007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a224c6-708e-4a5d-82a5-439f36fba242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:42 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Volume f9be31fb-982a-4f54-b161-0aae76d7e1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca', 'volume_size': 2} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a 1G" returned: 0 in 0.888s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451" returned: 0 in 2.320s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[091db7fc-497c-4407-a902-05465dc306f8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4443b8-dbe7-4144-98a5-38fddf17faea]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:42 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:42 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:42 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:42 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:43 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.554s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:43 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Converted 1024.00 MB image at 441.19 MB/s Apr 21 20:58:43 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 is being set with open permissions: ugo+rw Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 Apr 21 20:58:43 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 1 in 0.466s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Downloaded image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume 62ec0076-630d-4961-9068-ab6045dff68a successfully. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f for user f3f052b709894347908adf967666f391 is deleted. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Marking volume 62ec0076-630d-4961-9068-ab6045dff68a as bootable. {{(pid=82005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Copying metadata from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f to 62ec0076-630d-4961-9068-ab6045dff68a. {{(pid=82005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Creating volume glance metadata for volume 62ec0076-630d-4961-9068-ab6045dff68a backed by image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:58:43 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451" returned: 0 in 0.429s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-4597342a-e41d-4837-a196-b7e6ca03e451" released by "_copy_volume_from_snapshot" :: held 4.593s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c748ddd3-9ba9-4f19-b97b-861fcf64324f-4597342a-e41d-4837-a196-b7e6ca03e451" released by "_create_volume_from_snapshot" :: held 4.614s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.632s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1029338185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9be31fb-982a-4f54-b161-0aae76d7e1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a48b2aaefa945288a0086ccd3fd78c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:43Z,use_quota=True,user_id='c30228b4637549cda39bd9e24a5c285e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Creating volume f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:43 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca 2147483648 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca 2147483648 Apr 21 20:58:43 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0349c483-6500-4169-896d-175f5d19688a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4597342a-e41d-4837-a196-b7e6ca03e451', 'volume_size': 1, 'snapshot_id': 'c748ddd3-9ba9-4f19-b97b-861fcf64324f'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd3fb26-e1f6-45fa-ade9-f5b5418e8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4c094-db27-4b1d-bafd-b95d35b56524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ec0076-630d-4961-9068-ab6045dff68a', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ebd3e1-324f-483d-a902-f4356ff10aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:43 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Volume volume-4597342a-e41d-4837-a196-b7e6ca03e451 (4597342a-e41d-4837-a196-b7e6ca03e451): created successfully Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd3fb26-e1f6-45fa-ade9-f5b5418e8a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Flow 'volume_create_manager' (caea325d-f44f-4060-aeec-7ed40a0d6496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:43 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Volume volume-62ec0076-630d-4961-9068-ab6045dff68a (62ec0076-630d-4961-9068-ab6045dff68a): created successfully Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ebd3e1-324f-483d-a902-f4356ff10aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Flow 'volume_create_manager' (2cb76165-4e09-4f77-acda-65b26c7d768b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-adac5c90-0512-4ff6-a6a6-2992cc8f7109 tempest-VolumesImageMetadata-2009360299 None] Created volume successfully. Apr 21 20:58:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7fe33070-8546-4d09-b289-f3c3cd6e20b8 tempest-VolumesDeleteCascade-1243634591 None] Created volume successfully. Apr 21 20:58:44 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca 2147483648" returned: 0 in 0.498s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca Apr 21 20:58:44 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-c6eda96f-a4de-4605-b2db-3a809fd6b097-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c6eda96f-a4de-4605-b2db-3a809fd6b097-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Performing cascade delete. {{(pid=82005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-c748ddd3-9ba9-4f19-b97b-861fcf64324f-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c748ddd3-9ba9-4f19-b97b-861fcf64324f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c6eda96f-a4de-4605-b2db-3a809fd6b097" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c6eda96f-a4de-4605-b2db-3a809fd6b097" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c748ddd3-9ba9-4f19-b97b-861fcf64324f" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c748ddd3-9ba9-4f19-b97b-861fcf64324f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Deleting offline snapshot c748ddd3-9ba9-4f19-b97b-861fcf64324f of volume c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] snapshot_file for this snap is: volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca" returned: 0 in 0.426s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9e819d-3716-4f0f-89b2-ace0de5bb077]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a224c6-708e-4a5d-82a5-439f36fba242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca', 'volume_size': 2}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52d3034-a6ea-4269-9a19-695d38cc510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:44 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Volume volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca (f9be31fb-982a-4f54-b161-0aae76d7e1ca): created successfully Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52d3034-a6ea-4269-9a19-695d38cc510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Flow 'volume_create_manager' (a9202977-71bf-4246-b6d5-a69fca1f08af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:44 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a152647e-90b3-4d27-bd85-14316406d8ee tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Created volume successfully. Apr 21 20:58:44 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f Apr 21 20:58:44 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Acquiring lock "cinder-62ec0076-630d-4961-9068-ab6045dff68a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Lock "cinder-62ec0076-630d-4961-9068-ab6045dff68a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Acquiring lock "cinder-quobyte-62ec0076-630d-4961-9068-ab6045dff68a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Lock "cinder-quobyte-62ec0076-630d-4961-9068-ab6045dff68a" acquired by "delete_volume" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8744a1b7-0bfa-437f-a1e1-f008853bd869]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:45 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6eda96f-a4de-4605-b2db-3a809fd6b097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1d11e-99cd-4cd8-94c9-bbcdf911cf05]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:45 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 0 in 0.451s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:45 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f Apr 21 20:58:45 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Creating offline snapshot 56e685d5-64a9-4a01-8cc7-3f40537b31fb of volume f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec66248-f0ec-45a2-ad47-028cec49b955]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 1 in 0.515s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca Apr 21 20:58:46 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a Apr 21 20:58:46 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f" returned: 0 in 0.489s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f Apr 21 20:58:46 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-62ec0076-630d-4961-9068-ab6045dff68a" returned: 0 in 0.418s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Lock "cinder-quobyte-62ec0076-630d-4961-9068-ab6045dff68a" released by "delete_volume" :: held 1.423s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:46 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca" returned: 0 in 0.502s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb 2G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb 2G Apr 21 20:58:46 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Created reservations ['bdb63ed1-2a7f-4491-a4fa-b124836beec1', '97902822-b74a-496c-8c38-6c5ae979b0c1', '59937028-103b-44ab-9bd4-18a4bf3698d3', 'a6ff3372-0574-4cda-bf8d-cc976fb1157c'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:46 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097.c748ddd3-9ba9-4f19-b97b-861fcf64324f" returned: 0 in 0.435s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c748ddd3-9ba9-4f19-b97b-861fcf64324f" released by "_delete_snapshot" :: held 1.991s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c6eda96f-a4de-4605-b2db-3a809fd6b097" released by "delete_snapshot" :: held 2.009s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Created reservations ['14816e31-0af0-419a-981e-33d5ccfc3483', 'b4d652b5-b540-49fc-b3d3-7fe07f3a0c7d', 'babc3c25-b7ff-4438-a047-5414740fb34d', '28bfa434-657c-4066-83ec-79ad12df4b53'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Delete snapshot completed successfully. Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c748ddd3-9ba9-4f19-b97b-861fcf64324f-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Snapshots deleted, issuing volume delete {{(pid=82005) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-c6eda96f-a4de-4605-b2db-3a809fd6b097" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c6eda96f-a4de-4605-b2db-3a809fd6b097" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7113f7-ba99-4f20-88b7-358c040c0d4e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:46 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:47 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.429s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:47 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb 2G" returned: 0 in 0.509s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:47 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Deleted volume successfully. Apr 21 20:58:47 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb Apr 21 20:58:47 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0fc881d5-71f4-471a-9278-5ad0ad3761ec tempest-VolumesImageMetadata-2009360299 None] Lock "cinder-62ec0076-630d-4961-9068-ab6045dff68a-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:47 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.500s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:47 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097 Apr 21 20:58:47 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:47 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:47 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb is being set with open permissions: ugo+rw Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:47 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb Apr 21 20:58:47 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:47 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6eda96f-a4de-4605-b2db-3a809fd6b097" returned: 0 in 0.444s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-c6eda96f-a4de-4605-b2db-3a809fd6b097" released by "delete_volume" :: held 0.972s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Created reservations ['afeeaab4-4e04-4289-8c3f-d5bd6e7b175b', '11875db6-94de-49da-9820-4ac0659ff80a', 'a89e46e2-82b0-4c49-8a0b-d10a8f5fb267', '0169e70a-d35b-4782-b8ab-eb9a005366c9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:47 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:47 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:48 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:48 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info Apr 21 20:58:48 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:48 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.418s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Deleted volume successfully. Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2de9a0a5-6f11-4f9c-b7df-605071b4e848 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-c6eda96f-a4de-4605-b2db-3a809fd6b097-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:48 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:48 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info is being set with open permissions: ugo+rw Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:48 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info Apr 21 20:58:48 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:48 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.info" returned: 0 in 0.417s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:49 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-909d6173-8557-4863-9132-9a8a7b8e234e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Create snapshot completed successfully Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Flow 'volume_create_manager' (d0ec8928-2a5c-4b62-862e-13d070547732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6274226c-56b5-4057-8fd9-f1218f5f6d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6274226c-56b5-4057-8fd9-f1218f5f6d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-125650165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4d7ead-8d7f-488e-8618-5e7893fa1436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46aa813b974d86a79f207cdfcb846b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:49Z,use_quota=True,user_id='d041bcb26f774577a30feeb1c51338b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff72b6b8-c821-431e-8aec-918cd6730ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff72b6b8-c821-431e-8aec-918cd6730ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964195af-5e48-45c4-99d7-3c0d9881b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964195af-5e48-45c4-99d7-3c0d9881b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4d7ead-8d7f-488e-8618-5e7893fa1436', 'volume_name': 'volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab305730-b2d6-456f-9a6c-68bc17018893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab305730-b2d6-456f-9a6c-68bc17018893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636c2418-59f2-452f-88b3-106b52708e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:49 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Volume ab4d7ead-8d7f-488e-8618-5e7893fa1436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436', 'volume_size': 1} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-125650165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4d7ead-8d7f-488e-8618-5e7893fa1436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b46aa813b974d86a79f207cdfcb846b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:49Z,use_quota=True,user_id='d041bcb26f774577a30feeb1c51338b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Creating volume ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:49 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-4597342a-e41d-4837-a196-b7e6ca03e451-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:49 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 1073741824 Apr 21 20:58:49 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-4597342a-e41d-4837-a196-b7e6ca03e451-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "cinder-quobyte-4597342a-e41d-4837-a196-b7e6ca03e451" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-4597342a-e41d-4837-a196-b7e6ca03e451" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7626da9c-28e1-4700-8199-d3bcea0e5e03]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 Apr 21 20:58:49 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "cinder-56e685d5-64a9-4a01-8cc7-3f40537b31fb-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-56e685d5-64a9-4a01-8cc7-3f40537b31fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "cinder-quobyte-f9be31fb-982a-4f54-b161-0aae76d7e1ca" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-quobyte-f9be31fb-982a-4f54-b161-0aae76d7e1ca" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "cinder-quobyte-56e685d5-64a9-4a01-8cc7-3f40537b31fb" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-quobyte-56e685d5-64a9-4a01-8cc7-3f40537b31fb" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Deleting offline snapshot 56e685d5-64a9-4a01-8cc7-3f40537b31fb of volume f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] snapshot_file for this snap is: volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af4d98-630f-4bba-af9e-bff10729aa7f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb Apr 21 20:58:49 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 1073741824" returned: 0 in 0.504s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 Apr 21 20:58:49 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451" returned: 0 in 0.531s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451 Apr 21 20:58:49 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf500d-9680-436b-b971-8d0bc6921ba0]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca Apr 21 20:58:49 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:50 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636c2418-59f2-452f-88b3-106b52708e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45acbfcf-26eb-4beb-b46c-57d76832024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Volume volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 (ab4d7ead-8d7f-488e-8618-5e7893fa1436): created successfully Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45acbfcf-26eb-4beb-b46c-57d76832024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Flow 'volume_create_manager' (d0ec8928-2a5c-4b62-862e-13d070547732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:50 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-4597342a-e41d-4837-a196-b7e6ca03e451" returned: 0 in 0.446s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-40c439b1-d599-4f46-b45c-0a09caf9badd tempest-SnapshotMetadataTestJSON-1141336352 None] Created volume successfully. Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-quobyte-4597342a-e41d-4837-a196-b7e6ca03e451" released by "delete_volume" :: held 1.004s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Created reservations ['ff8191fe-2295-47ac-b68d-d706b51f9d18', '668a2b63-0448-4b6c-bba2-61f3b6148492', '7fb1f01b-528c-4ee3-b07d-4b9da1aaab5a', '4c4e317d-c5a7-4130-a958-fdb784e1650b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:50 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:50 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca" returned: 0 in 0.535s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb Apr 21 20:58:50 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:50 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:50 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Deleted volume successfully. Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1779dd4d-3a2a-430c-886c-80256a0f1099 tempest-VolumesDeleteCascade-1243634591 None] Lock "cinder-4597342a-e41d-4837-a196-b7e6ca03e451-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:50 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb Apr 21 20:58:50 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:51 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Creating offline snapshot 399f5354-2c50-4390-8f78-01f2a828ae4e of volume ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca.56e685d5-64a9-4a01-8cc7-3f40537b31fb" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb064e69-f388-4897-8da2-e86e091d40fc]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-quobyte-56e685d5-64a9-4a01-8cc7-3f40537b31fb" released by "_delete_snapshot" :: held 2.049s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-quobyte-f9be31fb-982a-4f54-b161-0aae76d7e1ca" released by "delete_snapshot" :: held 2.062s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Created reservations ['3c72a2d2-b27f-45d0-ba67-2d65ee486330', '6da3f7d8-f72f-4c71-9705-a90417aedfe1', '10c8baa3-b6c2-46bb-8202-d3bb6276d3f2', 'ed52b0f0-fa9c-4849-b802-73f646350a28'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:51 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 Apr 21 20:58:51 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Delete snapshot completed successfully. Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-224a43bf-ae0d-4ecc-aef4-b872d438b76e tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-56e685d5-64a9-4a01-8cc7-3f40537b31fb-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:51 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436" returned: 0 in 0.547s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e 1G Apr 21 20:58:51 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e 1G" returned: 0 in 0.518s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e Apr 21 20:58:52 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "cinder-f9be31fb-982a-4f54-b161-0aae76d7e1ca-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-f9be31fb-982a-4f54-b161-0aae76d7e1ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "cinder-quobyte-f9be31fb-982a-4f54-b161-0aae76d7e1ca" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-quobyte-f9be31fb-982a-4f54-b161-0aae76d7e1ca" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb8656f-dcc4-4ecb-b45d-1c275ad1fe9a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca Apr 21 20:58:52 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e is being set with open permissions: ugo+rw Apr 21 20:58:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e Apr 21 20:58:52 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Flow 'volume_create_manager' (ca083431-8201-4603-9e68-6dbac7735f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c70847-6f96-4c03-976f-5d55e1609da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c70847-6f96-4c03-976f-5d55e1609da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2059212595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d686789b2f14580a1ef673ea04c5546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:53Z,use_quota=True,user_id='039caf3f37f64eba8c0c205ba0f27882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28994784-7e20-4082-a9f3-383f1ecbc00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:53 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28994784-7e20-4082-a9f3-383f1ecbc00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5050877b-7c73-43c5-a7d0-96ff7f55427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5050877b-7c73-43c5-a7d0-96ff7f55427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb', 'volume_name': 'volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa6a8d6-52af-4305-9b51-ee7218ce668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa6a8d6-52af-4305-9b51-ee7218ce668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e260226-a44a-4bca-aa74-c056e7ebcbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:53 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Volume d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb', 'volume_size': 1} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca Apr 21 20:58:53 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e" returned: 0 in 0.448s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info Apr 21 20:58:53 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f9be31fb-982a-4f54-b161-0aae76d7e1ca" returned: 0 in 0.432s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-quobyte-f9be31fb-982a-4f54-b161-0aae76d7e1ca" released by "delete_volume" :: held 1.030s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Created reservations ['dc10b7e4-79e6-48a1-8b95-6808797c2f08', '15326810-dd56-48c4-a622-33b91f8cdc7d', 'c383cca2-bbaa-46c9-ae1a-4cc5602bd9c7', '78651dcb-f487-41c2-bd28-29de93d5c146'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:53 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info" returned: 0 in 0.417s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info is being set with open permissions: ugo+rw Apr 21 20:58:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info Apr 21 20:58:53 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.387s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:54 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Deleted volume successfully. Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc4f0099-cb4e-446f-b0e6-52928e1dda40 tempest-VolumesSnapshotNegativeTestJSON-599931306 None] Lock "cinder-f9be31fb-982a-4f54-b161-0aae76d7e1ca-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:54 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.info" returned: 0 in 0.404s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2059212595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d686789b2f14580a1ef673ea04c5546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:53Z,use_quota=True,user_id='039caf3f37f64eba8c0c205ba0f27882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Creating volume d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:54 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb 1073741824 Apr 21 20:58:54 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a21287d6-9d74-46cc-9264-f7f96575024c tempest-SnapshotMetadataTestJSON-1141336352 None] Create snapshot completed successfully Apr 21 20:58:54 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb 1073741824" returned: 0 in 0.565s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb Apr 21 20:58:54 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "cinder-399f5354-2c50-4390-8f78-01f2a828ae4e-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-399f5354-2c50-4390-8f78-01f2a828ae4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "cinder-quobyte-ab4d7ead-8d7f-488e-8618-5e7893fa1436" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-quobyte-ab4d7ead-8d7f-488e-8618-5e7893fa1436" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "cinder-quobyte-399f5354-2c50-4390-8f78-01f2a828ae4e" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-quobyte-399f5354-2c50-4390-8f78-01f2a828ae4e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Deleting offline snapshot 399f5354-2c50-4390-8f78-01f2a828ae4e of volume ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] snapshot_file for this snap is: volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a2c2b-65b7-423c-9c07-2090d49a310f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e Apr 21 20:58:54 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:55 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb" returned: 0 in 0.483s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e260226-a44a-4bca-aa74-c056e7ebcbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e05e60d-c0e7-4b78-ba0b-2daad9a23fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Volume volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb (d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb): created successfully Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e05e60d-c0e7-4b78-ba0b-2daad9a23fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Flow 'volume_create_manager' (ca083431-8201-4603-9e68-6dbac7735f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e928c2b9-e460-4c97-92bf-3d0e4a8942fb tempest-VolumesListTestJSON-665603147 None] Created volume successfully. Apr 21 20:58:55 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e" returned: 0 in 0.547s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259ff20-178c-4bea-b982-fc0a7017df20]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:55 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 Apr 21 20:58:55 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:55 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:55 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e Apr 21 20:58:55 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (f86fc5f2-748e-4ca7-97fb-a0469887239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c391b6-ef70-4a37-9b5d-3f1fdd0a616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c391b6-ef70-4a37-9b5d-3f1fdd0a616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462429790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b27bb2-1e78-4e15-972d-544fc5320a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:56Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244052d4-781e-45b0-9b20-2535a912396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244052d4-781e-45b0-9b20-2535a912396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e24dd-acbc-4ce3-8f94-aaf3ea62957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e24dd-acbc-4ce3-8f94-aaf3ea62957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b27bb2-1e78-4e15-972d-544fc5320a3d', 'volume_name': 'volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79877ea9-cf23-46c2-9efc-358fbbe5fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79877ea9-cf23-46c2-9efc-358fbbe5fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dc8cb4-458e-413e-9480-16ddeb766221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume f4b27bb2-1e78-4e15-972d-544fc5320a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d', 'volume_size': 1} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462429790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b27bb2-1e78-4e15-972d-544fc5320a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:56Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating volume f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:56 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:56 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d 1073741824 Apr 21 20:58:56 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:56 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:56 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e Apr 21 20:58:56 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Flow 'volume_create_manager' (623d96fc-0e13-4286-b9f6-89f8d007d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778eac4c-7d56-411a-a6af-893d69129c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778eac4c-7d56-411a-a6af-893d69129c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1508337211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719d6310-ba04-4d33-9927-87da9370c21d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d686789b2f14580a1ef673ea04c5546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:56Z,use_quota=True,user_id='039caf3f37f64eba8c0c205ba0f27882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa0b0b5-10a0-4597-885a-b71cd7443d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa0b0b5-10a0-4597-885a-b71cd7443d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a28abe-b24b-441e-9106-e304a84326ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a28abe-b24b-441e-9106-e304a84326ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719d6310-ba04-4d33-9927-87da9370c21d', 'volume_name': 'volume-719d6310-ba04-4d33-9927-87da9370c21d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9c42c0-f257-4749-a56f-689effcdb39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9c42c0-f257-4749-a56f-689effcdb39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4094a4cc-7cc5-4319-b527-745f511f0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Volume 719d6310-ba04-4d33-9927-87da9370c21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719d6310-ba04-4d33-9927-87da9370c21d', 'volume_size': 1} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:56 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d 1073741824" returned: 0 in 0.489s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:56 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d Apr 21 20:58:56 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:56 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436.399f5354-2c50-4390-8f78-01f2a828ae4e" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-quobyte-399f5354-2c50-4390-8f78-01f2a828ae4e" released by "_delete_snapshot" :: held 2.080s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-quobyte-ab4d7ead-8d7f-488e-8618-5e7893fa1436" released by "delete_snapshot" :: held 2.094s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:56 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Created reservations ['5e726748-8b8f-4287-b81e-73dfc7c6e00c', '30e6f682-fe7c-4cf6-902c-2b463e953114', '10c63435-a387-4c70-9505-81e7934fe1d4', '1b7382ca-4eea-4e59-8842-4f9a98de7e51'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:56 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Delete snapshot completed successfully. Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b6df6d6-867b-44a7-ae87-75fa21990724 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-399f5354-2c50-4390-8f78-01f2a828ae4e-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:57 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1508337211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719d6310-ba04-4d33-9927-87da9370c21d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d686789b2f14580a1ef673ea04c5546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:56Z,use_quota=True,user_id='039caf3f37f64eba8c0c205ba0f27882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Creating volume 719d6310-ba04-4d33-9927-87da9370c21d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:57 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dc8cb4-458e-413e-9480-16ddeb766221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:57 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d 1073741824 Apr 21 20:58:57 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6e8bd7-e2a6-43e5-8cd7-8a91a757c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:57 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d (f4b27bb2-1e78-4e15-972d-544fc5320a3d): created successfully Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6e8bd7-e2a6-43e5-8cd7-8a91a757c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (f86fc5f2-748e-4ca7-97fb-a0469887239a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:57 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d5b39d12-e2b2-4eb7-9750-c8f2b6f5b614 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created volume successfully. Apr 21 20:58:57 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d 1073741824" returned: 0 in 0.504s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:57 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d Apr 21 20:58:57 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "cinder-ab4d7ead-8d7f-488e-8618-5e7893fa1436-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-ab4d7ead-8d7f-488e-8618-5e7893fa1436-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "cinder-quobyte-ab4d7ead-8d7f-488e-8618-5e7893fa1436" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-quobyte-ab4d7ead-8d7f-488e-8618-5e7893fa1436" acquired by "delete_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3675a92-9f03-471f-be2d-9037ae7ad5e7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 Apr 21 20:58:58 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d" returned: 0 in 0.417s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4094a4cc-7cc5-4319-b527-745f511f0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719d6310-ba04-4d33-9927-87da9370c21d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39cca42-1925-4375-b14a-8ef4f0a18c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Volume volume-719d6310-ba04-4d33-9927-87da9370c21d (719d6310-ba04-4d33-9927-87da9370c21d): created successfully Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39cca42-1925-4375-b14a-8ef4f0a18c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Flow 'volume_create_manager' (623d96fc-0e13-4286-b9f6-89f8d007d30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:58 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ea01d205-8172-4dde-9169-3872c2d17a08 tempest-VolumesListTestJSON-665603147 None] Created volume successfully. Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating offline snapshot d17b976e-ad48-493e-8b3f-5446e0eebc36 of volume f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eea4e3-6311-418d-91f7-04dbbe284a4d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436 Apr 21 20:58:58 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d Apr 21 20:58:58 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Flow 'volume_create_manager' (729e53a7-0009-408c-a6b7-3efa13d6dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c22870-ba9b-4086-bc02-6390ceaf0875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c22870-ba9b-4086-bc02-6390ceaf0875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1068811619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921bc3f9-5b79-4422-b2bf-1c26cafd7559,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d686789b2f14580a1ef673ea04c5546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:59Z,use_quota=True,user_id='039caf3f37f64eba8c0c205ba0f27882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af44bc7-9210-45d4-9fa7-44a04fe3e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af44bc7-9210-45d4-9fa7-44a04fe3e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0e7bed-da72-46fe-a067-8ac70977224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0e7bed-da72-46fe-a067-8ac70977224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921bc3f9-5b79-4422-b2bf-1c26cafd7559', 'volume_name': 'volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fd4f7a-3a38-404c-98c0-6f6918d2df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fd4f7a-3a38-404c-98c0-6f6918d2df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87e82e-1aec-45d0-afc8-c7543436d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Volume 921bc3f9-5b79-4422-b2bf-1c26cafd7559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559', 'volume_size': 1} Apr 21 20:58:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:59 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 1G Apr 21 20:58:59 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ab4d7ead-8d7f-488e-8618-5e7893fa1436" returned: 0 in 0.492s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-quobyte-ab4d7ead-8d7f-488e-8618-5e7893fa1436" released by "delete_volume" :: held 1.022s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Created reservations ['d7d846b8-c503-4e1d-a274-5de4f937ac8b', '98d3adea-3868-4eba-b170-2c83806dfc67', 'b06b2832-f5d3-4f6b-aca8-4715e8536ed3', 'fd674b35-0ec9-4219-a610-2c552df5c979'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:58:59 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 1G" returned: 0 in 0.495s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 Apr 21 20:58:59 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Deleted volume successfully. Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-098ffe9b-4e7d-4206-b179-c6827444ab80 tempest-SnapshotMetadataTestJSON-1141336352 None] Lock "cinder-ab4d7ead-8d7f-488e-8618-5e7893fa1436-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:59 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36" returned: 0 in 0.420s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 is being set with open permissions: ugo+rw Apr 21 20:58:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 Apr 21 20:58:59 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:00 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36" returned: 0 in 0.426s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:00 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info Apr 21 20:59:00 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:00 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info" returned: 0 in 0.435s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:00 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info is being set with open permissions: ugo+rw Apr 21 20:59:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:00 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info Apr 21 20:59:00 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:01 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.info" returned: 0 in 0.455s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1068811619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921bc3f9-5b79-4422-b2bf-1c26cafd7559,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d686789b2f14580a1ef673ea04c5546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:59Z,use_quota=True,user_id='039caf3f37f64eba8c0c205ba0f27882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Creating volume 921bc3f9-5b79-4422-b2bf-1c26cafd7559 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:01 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:01 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 1073741824 Apr 21 20:59:01 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:01 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-dd3b9741-2da5-46a2-9c25-9231a7cdf5c2 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Create snapshot completed successfully Apr 21 20:59:01 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 1073741824" returned: 0 in 0.570s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (c9042d53-c55c-44a0-b168-3c0a82badba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa73c0b-a8d6-49db-ad32-2155faf4df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa73c0b-a8d6-49db-ad32-2155faf4df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959699325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450b14a8-1e67-4518-a9f7-d121504ae911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:02Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6159a57c-5045-4a3a-94ee-3ef48fe5531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6159a57c-5045-4a3a-94ee-3ef48fe5531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559db4f8-eb01-490e-aaf5-221feab7364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559db4f8-eb01-490e-aaf5-221feab7364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '450b14a8-1e67-4518-a9f7-d121504ae911', 'volume_name': 'volume-450b14a8-1e67-4518-a9f7-d121504ae911', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d420007-05b7-4bd8-9fde-d384aacaa40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d420007-05b7-4bd8-9fde-d384aacaa40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59994baf-d364-460a-a30e-92193f142d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:01 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume 450b14a8-1e67-4518-a9f7-d121504ae911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-450b14a8-1e67-4518-a9f7-d121504ae911', 'volume_size': 1} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:01 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 Apr 21 20:59:01 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (f7ed6dd6-53f6-4e57-9e90-91573c168c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681a3f83-0341-4cf2-aa39-1a9849ab4c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681a3f83-0341-4cf2-aa39-1a9849ab4c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859101294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab88ec3-648d-453a-af87-ace436548faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:02Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e029a488-bcb3-416b-9f64-8fa8dcad36a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e029a488-bcb3-416b-9f64-8fa8dcad36a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ae1b4f-5380-4f3a-9799-5337c1d819e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ae1b4f-5380-4f3a-9799-5337c1d819e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab88ec3-648d-453a-af87-ace436548faa', 'volume_name': 'volume-3ab88ec3-648d-453a-af87-ace436548faa', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa5e184-6f8f-4ac3-a091-12cbf61f1e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa5e184-6f8f-4ac3-a091-12cbf61f1e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca18302-3986-43be-ba47-793533832269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume 3ab88ec3-648d-453a-af87-ace436548faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab88ec3-648d-453a-af87-ace436548faa', 'volume_size': 1} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (36d28c52-08b3-4dc6-b213-d8c329069817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ee5216-5985-4cd2-9a80-c6938dc992ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ee5216-5985-4cd2-9a80-c6938dc992ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9920481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b16b24c-8226-428d-9089-a84ccdd1cb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:02Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b99f549-0df2-4bcf-affb-ca8e9c571d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b99f549-0df2-4bcf-affb-ca8e9c571d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5140f3-303d-4a5f-a681-f0be31438bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5140f3-303d-4a5f-a681-f0be31438bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b16b24c-8226-428d-9089-a84ccdd1cb7a', 'volume_name': 'volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b4ac86-59ba-4a0a-b3ac-90069d4f7ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b4ac86-59ba-4a0a-b3ac-90069d4f7ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1747bd-3837-4db3-87f3-6b9c751e2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume 0b16b24c-8226-428d-9089-a84ccdd1cb7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a', 'volume_size': 1} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:02 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559" returned: 0 in 0.622s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959699325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450b14a8-1e67-4518-a9f7-d121504ae911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:02Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating volume 450b14a8-1e67-4518-a9f7-d121504ae911 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:02 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 1073741824 Apr 21 20:59:02 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87e82e-1aec-45d0-afc8-c7543436d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e0506b-78fc-4618-a1ba-36567f650c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Volume volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 (921bc3f9-5b79-4422-b2bf-1c26cafd7559): created successfully Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e0506b-78fc-4618-a1ba-36567f650c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Flow 'volume_create_manager' (729e53a7-0009-408c-a6b7-3efa13d6dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-be67ada0-159a-4585-bc47-c5b32f0133f4 tempest-VolumesListTestJSON-665603147 None] Created volume successfully. Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (05a4ee67-b4f0-4c31-b372-8df640de5c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9fcc45-676d-4288-848f-4bfcbe49e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9fcc45-676d-4288-848f-4bfcbe49e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302781250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:03Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd33ae2a-a222-46ec-bf87-29ad3d282550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd33ae2a-a222-46ec-bf87-29ad3d282550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebc7196-dc92-460a-8784-62c305e7386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebc7196-dc92-460a-8784-62c305e7386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3', 'volume_name': 'volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92af8a20-9b39-476a-af96-2f1ba4c232ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92af8a20-9b39-476a-af96-2f1ba4c232ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ff77d6-09a7-443f-84f9-973b1f3469f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3', 'volume_size': 1} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (c789097b-b67c-4435-9791-de33ce856770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5812d4f-5238-4394-8475-72dc6509e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=176,cinder:DELETE=17,cinder:SELECT=163,cinder:INSERT=48 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5812d4f-5238-4394-8475-72dc6509e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630446206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0089ec0d-681d-4fc0-a770-62d86d41a465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:03Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3998dc2-7126-4d9b-bfa7-becae9d8800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3998dc2-7126-4d9b-bfa7-becae9d8800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1aea2-783a-4136-8357-a055893bdd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1aea2-783a-4136-8357-a055893bdd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0089ec0d-681d-4fc0-a770-62d86d41a465', 'volume_name': 'volume-0089ec0d-681d-4fc0-a770-62d86d41a465', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcea945-6207-4163-b2d6-5e49c21b6ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcea945-6207-4163-b2d6-5e49c21b6ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dac8c44-0f26-4482-8c8f-714bc94cda4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:02 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume 0089ec0d-681d-4fc0-a770-62d86d41a465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0089ec0d-681d-4fc0-a770-62d86d41a465', 'volume_size': 1} Apr 21 20:59:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:03 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 1073741824" returned: 0 in 0.658s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 Apr 21 20:59:03 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:03 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859101294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab88ec3-648d-453a-af87-ace436548faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:02Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating volume 3ab88ec3-648d-453a-af87-ace436548faa {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:03 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59994baf-d364-460a-a30e-92193f142d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450b14a8-1e67-4518-a9f7-d121504ae911', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baadffa2-6a37-4a4e-8094-f64d80639c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:03 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa 1073741824 Apr 21 20:59:03 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:03 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume volume-450b14a8-1e67-4518-a9f7-d121504ae911 (450b14a8-1e67-4518-a9f7-d121504ae911): created successfully Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baadffa2-6a37-4a4e-8094-f64d80639c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (c9042d53-c55c-44a0-b168-3c0a82badba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4a3750ef-3e10-451d-a5e4-b1992c353076 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created volume successfully. Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Flow 'volume_create_manager' (15aed88a-ba1b-4248-a749-f3cb889d9076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbd54a8-8e26-4787-ba52-4dc9e099d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbd54a8-8e26-4787-ba52-4dc9e099d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-473681414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22451a11-6604-4816-be02-e72f2d1f8323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f4b856408410fa5982e219542f0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:04Z,use_quota=True,user_id='df65cca5ea7d444c939e6d817882341e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b3a94a-1515-4191-9ce8-1ddfa4ff0cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b3a94a-1515-4191-9ce8-1ddfa4ff0cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3adfe9f-3c0f-498d-b811-b53e3ef0ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3adfe9f-3c0f-498d-b811-b53e3ef0ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22451a11-6604-4816-be02-e72f2d1f8323', 'volume_name': 'volume-22451a11-6604-4816-be02-e72f2d1f8323', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d853b7c6-458f-4b12-9dc5-ca21ab8ddd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d853b7c6-458f-4b12-9dc5-ca21ab8ddd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5e2eff-9875-4682-adb8-701b9c35f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Volume 22451a11-6604-4816-be02-e72f2d1f8323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22451a11-6604-4816-be02-e72f2d1f8323', 'volume_size': 1} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:04 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa 1073741824" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:04 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa Apr 21 20:59:04 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa" returned: 0 in 0.430s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9920481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b16b24c-8226-428d-9089-a84ccdd1cb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:02Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating volume 0b16b24c-8226-428d-9089-a84ccdd1cb7a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:04 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca18302-3986-43be-ba47-793533832269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab88ec3-648d-453a-af87-ace436548faa', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a 1073741824 Apr 21 20:59:04 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209f4637-e84c-45c9-b103-479ffa8d141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume volume-3ab88ec3-648d-453a-af87-ace436548faa (3ab88ec3-648d-453a-af87-ace436548faa): created successfully Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209f4637-e84c-45c9-b103-479ffa8d141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (f7ed6dd6-53f6-4e57-9e90-91573c168c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:04 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-42153b28-7d1b-4a15-bce2-2ebc9e5b9139 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created volume successfully. Apr 21 20:59:05 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a 1073741824" returned: 0 in 0.544s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "cinder-921bc3f9-5b79-4422-b2bf-1c26cafd7559-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:05 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a Apr 21 20:59:05 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-921bc3f9-5b79-4422-b2bf-1c26cafd7559-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "cinder-quobyte-921bc3f9-5b79-4422-b2bf-1c26cafd7559" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-quobyte-921bc3f9-5b79-4422-b2bf-1c26cafd7559" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8327cb-16b4-41e7-9147-ebac6a97dbbf]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 Apr 21 20:59:05 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302781250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:03Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating volume e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:05 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1747bd-3837-4db3-87f3-6b9c751e2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:05 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 1073741824 Apr 21 20:59:05 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd23dab4-184c-4fbc-8e2a-71d79225daa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:05 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a (0b16b24c-8226-428d-9089-a84ccdd1cb7a): created successfully Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd23dab4-184c-4fbc-8e2a-71d79225daa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (36d28c52-08b3-4dc6-b213-d8c329069817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b83c775f-7237-41f4-9932-2f3fdd36a986 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created volume successfully. Apr 21 20:59:05 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559" returned: 0 in 0.531s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559 Apr 21 20:59:05 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 1073741824" returned: 0 in 0.501s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 Apr 21 20:59:06 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-921bc3f9-5b79-4422-b2bf-1c26cafd7559" returned: 0 in 0.491s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-quobyte-921bc3f9-5b79-4422-b2bf-1c26cafd7559" released by "delete_volume" :: held 1.048s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Created reservations ['14760137-8fb0-43a9-bf86-751e3b873b32', 'bda51061-b455-45a9-b9be-0ce2628bfc95', '8746f375-8e18-4d34-996a-60764758f922', '6816b180-a953-4829-8545-90eb846affdd'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:06 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630446206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0089ec0d-681d-4fc0-a770-62d86d41a465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934839dd81b947728d93e6d374c4f702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:03Z,use_quota=True,user_id='e90f7d6b9aa348cdbc812cf08f7af311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Creating volume 0089ec0d-681d-4fc0-a770-62d86d41a465 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:06 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 1073741824 Apr 21 20:59:06 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ff77d6-09a7-443f-84f9-973b1f3469f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f82a5f-5a4d-4b23-95e6-101879849b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:06 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 (e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3): created successfully Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f82a5f-5a4d-4b23-95e6-101879849b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (05a4ee67-b4f0-4c31-b372-8df640de5c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9c779174-0743-428a-80de-240387a77418 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created volume successfully. Apr 21 20:59:06 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Deleted volume successfully. Apr 21 20:59:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c912064-8e0c-4949-9c9e-19f717a6d478 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-921bc3f9-5b79-4422-b2bf-1c26cafd7559-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:07 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 1073741824" returned: 0 in 0.511s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 Apr 21 20:59:07 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Acquiring lock "cinder-719d6310-ba04-4d33-9927-87da9370c21d-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Lock "cinder-719d6310-ba04-4d33-9927-87da9370c21d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Acquiring lock "cinder-quobyte-719d6310-ba04-4d33-9927-87da9370c21d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Lock "cinder-quobyte-719d6310-ba04-4d33-9927-87da9370c21d" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3f8c0d-cef6-4c35-8dda-57b152a20e69]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d Apr 21 20:59:07 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-473681414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22451a11-6604-4816-be02-e72f2d1f8323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f4b856408410fa5982e219542f0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:04Z,use_quota=True,user_id='df65cca5ea7d444c939e6d817882341e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Creating volume 22451a11-6604-4816-be02-e72f2d1f8323 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:07 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dac8c44-0f26-4482-8c8f-714bc94cda4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0089ec0d-681d-4fc0-a770-62d86d41a465', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51360387-a3d1-4332-8eab-cf78756da1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:07 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 1073741824 Apr 21 20:59:07 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Volume volume-0089ec0d-681d-4fc0-a770-62d86d41a465 (0089ec0d-681d-4fc0-a770-62d86d41a465): created successfully Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51360387-a3d1-4332-8eab-cf78756da1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Flow 'volume_create_manager' (c789097b-b67c-4435-9791-de33ce856770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-de5896b5-1879-41b6-a60d-51b0214fedba tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created volume successfully. Apr 21 20:59:08 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d Apr 21 20:59:08 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 1073741824" returned: 0 in 0.492s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 Apr 21 20:59:08 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-0089ec0d-681d-4fc0-a770-62d86d41a465-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-0089ec0d-681d-4fc0-a770-62d86d41a465-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-0089ec0d-681d-4fc0-a770-62d86d41a465" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-0089ec0d-681d-4fc0-a770-62d86d41a465" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f0b3c1-acd8-4f25-948e-4b24b48f22b5]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-719d6310-ba04-4d33-9927-87da9370c21d" returned: 0 in 0.475s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 Apr 21 20:59:08 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Lock "cinder-quobyte-719d6310-ba04-4d33-9927-87da9370c21d" released by "delete_volume" :: held 0.955s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Created reservations ['cdd71c6b-ffa9-4c01-9f76-ec783cdaac7b', '50e81358-4574-4e66-bf2d-0cbb02dfc132', 'cce409a9-4c8a-410a-93da-35bd41a76fd8', '3a3beaf5-f13a-4dc8-9ba9-9894a7b3584e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:08 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "cinder-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5e2eff-9875-4682-adb8-701b9c35f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22451a11-6604-4816-be02-e72f2d1f8323', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee74cdc-9d76-4b41-9413-13b15d9f893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:08 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Volume volume-22451a11-6604-4816-be02-e72f2d1f8323 (22451a11-6604-4816-be02-e72f2d1f8323): created successfully Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee74cdc-9d76-4b41-9413-13b15d9f893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Flow 'volume_create_manager' (15aed88a-ba1b-4248-a749-f3cb889d9076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9953ced4-3a43-4894-97dd-2de3b79c37a9 tempest-AbsoluteLimitsTests-1486604937 None] Created volume successfully. Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "cinder-quobyte-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-quobyte-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1cc396-94b6-4588-abc2-0df9078519ff]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb Apr 21 20:59:08 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465" returned: 0 in 0.468s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465 Apr 21 20:59:08 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.452s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:09 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Deleted volume successfully. Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-425af987-720c-439e-b88e-90b312a8928f tempest-VolumesListTestJSON-665603147 None] Lock "cinder-719d6310-ba04-4d33-9927-87da9370c21d-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb Apr 21 20:59:09 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0089ec0d-681d-4fc0-a770-62d86d41a465" returned: 0 in 0.390s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-0089ec0d-681d-4fc0-a770-62d86d41a465" released by "delete_volume" :: held 0.881s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['0af888d2-28e8-47b6-8641-c8d3eec48e29', '67bcffc0-5232-4256-823d-2f30f7584711', '3307b623-beae-4d18-b7ae-e7d0691d3cfe', '1ed8fe75-33de-4112-8e8c-7f9ba1ebf1a5'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:09 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Acquiring lock "cinder-22451a11-6604-4816-be02-e72f2d1f8323-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Lock "cinder-22451a11-6604-4816-be02-e72f2d1f8323-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Acquiring lock "cinder-quobyte-22451a11-6604-4816-be02-e72f2d1f8323" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Lock "cinder-quobyte-22451a11-6604-4816-be02-e72f2d1f8323" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ccbe5-f654-4009-972c-21eda0ec73d3]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10ce174-752d-4261-8559-7b8643842865]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 Apr 21 20:59:09 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 Apr 21 20:59:09 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb" returned: 0 in 0.490s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-quobyte-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb" released by "delete_volume" :: held 0.978s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Created reservations ['4ee2d07c-2d3e-4679-a397-5ee2016c8a41', '43b693e0-47b3-4cb7-a2a4-cb32e575d01a', '048c4288-7e1a-42bf-8a60-718a2a78e62d', 'ddf1685f-667f-4bd9-b030-d0e9402e5961'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.479s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:09 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleted volume successfully. Apr 21 20:59:09 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:09 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-54707e59-44de-4621-854e-a29e6c3a1da4 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-0089ec0d-681d-4fc0-a770-62d86d41a465-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323" returned: 0 in 0.514s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323 Apr 21 20:59:10 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:10 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3" returned: 0 in 0.533s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3 Apr 21 20:59:10 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:10 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.391s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Deleted volume successfully. Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a5c0f9dd-55bd-435f-a046-370fa296a191 tempest-VolumesListTestJSON-665603147 None] Lock "cinder-d77c36c4-cfd0-4a81-9ec3-5fc889b5c7eb-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-22451a11-6604-4816-be02-e72f2d1f8323" returned: 0 in 0.402s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Lock "cinder-quobyte-22451a11-6604-4816-be02-e72f2d1f8323" released by "delete_volume" :: held 0.937s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Created reservations ['a1f71304-e7ba-42f9-94ad-a0e092a47de8', 'bfc86951-5143-442d-809b-0d2d3e852aad', '8314da85-1555-47c8-86af-816aba9e7281', 'ebba49f3-4486-4bf2-8e31-3cb3e2e6f6c4'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:10 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3" released by "delete_volume" :: held 1.044s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:10 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['82a766db-d9dc-43c7-9466-238cab8bc1f6', '30c812a5-f3e4-4f20-8c86-fe8bbab978dc', '121334df-a949-49e0-b87d-9be790507b69', '102a07f7-5871-4495-b6ea-e41a083bf94b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:10 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.455s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:11 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Deleted volume successfully. Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b8f6504d-4993-49ed-9938-4e2b13ae0d23 tempest-AbsoluteLimitsTests-1486604937 None] Lock "cinder-22451a11-6604-4816-be02-e72f2d1f8323-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:11 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:11 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleted volume successfully. Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c99ce8ec-bf1e-4292-b5f4-fbec5ec69a4f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-e0bc7f3e-2ad5-46ae-9718-6cba2a33aba3-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-0b16b24c-8226-428d-9089-a84ccdd1cb7a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-0b16b24c-8226-428d-9089-a84ccdd1cb7a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-0b16b24c-8226-428d-9089-a84ccdd1cb7a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-0b16b24c-8226-428d-9089-a84ccdd1cb7a" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48681db-f409-44cb-bda9-b131dd6103b1]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a Apr 21 20:59:11 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a" returned: 0 in 0.573s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a Apr 21 20:59:12 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Flow 'volume_create_manager' (a3c038bf-2f0f-421d-9b9a-3a077860e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44217e1-6c4a-4b9d-88f1-48a0459d4572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44217e1-6c4a-4b9d-88f1-48a0459d4572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-740526815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eccb96-7b20-4483-8757-900086d0a975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951e89a8508044f2b1c62c3f230c4d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:13Z,use_quota=True,user_id='9eaa351245f345899c7ae9c189368da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8191442-1318-4cdf-9f02-028e1f186bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8191442-1318-4cdf-9f02-028e1f186bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155e793-78cb-4761-b7cb-7ac16cdcd45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155e793-78cb-4761-b7cb-7ac16cdcd45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5eccb96-7b20-4483-8757-900086d0a975', 'volume_name': 'volume-b5eccb96-7b20-4483-8757-900086d0a975', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3c2b13-e355-48ba-8404-f50b77a443ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3c2b13-e355-48ba-8404-f50b77a443ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21aa2d-ad57-46cb-a8a1-26a20f54e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:12 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Volume b5eccb96-7b20-4483-8757-900086d0a975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5eccb96-7b20-4483-8757-900086d0a975', 'volume_size': 1} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-740526815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5eccb96-7b20-4483-8757-900086d0a975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951e89a8508044f2b1c62c3f230c4d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:13Z,use_quota=True,user_id='9eaa351245f345899c7ae9c189368da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Creating volume b5eccb96-7b20-4483-8757-900086d0a975 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:12 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 1073741824 Apr 21 20:59:12 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-0b16b24c-8226-428d-9089-a84ccdd1cb7a" returned: 0 in 0.528s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-0b16b24c-8226-428d-9089-a84ccdd1cb7a" released by "delete_volume" :: held 1.131s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:12 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['35db4179-757e-4ccd-aa8c-912bc2233861', '85d7f924-dfa0-443e-88e7-f83017c50b26', '04097a42-8905-43fa-8819-0520684abc11', 'c75cb998-7571-4f89-9f2e-2761f5c0bbfa'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:13 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:13 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:13 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 1073741824" returned: 0 in 0.561s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:13 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 Apr 21 20:59:13 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:13 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.504s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:13 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleted volume successfully. Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-1a8c0435-6229-4b8c-9086-5b127c80294f tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-0b16b24c-8226-428d-9089-a84ccdd1cb7a-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:13 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-3ab88ec3-648d-453a-af87-ace436548faa-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-3ab88ec3-648d-453a-af87-ace436548faa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e21aa2d-ad57-46cb-a8a1-26a20f54e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5eccb96-7b20-4483-8757-900086d0a975', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca61414-ea50-4be1-a4ba-ca3117db3cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:13 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Volume volume-b5eccb96-7b20-4483-8757-900086d0a975 (b5eccb96-7b20-4483-8757-900086d0a975): created successfully Apr 21 20:59:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca61414-ea50-4be1-a4ba-ca3117db3cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Flow 'volume_create_manager' (a3c038bf-2f0f-421d-9b9a-3a077860e657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:14 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-17bc8e40-1888-4cba-82d7-2903de75a119 tempest-VolumesNegativeTest-879121881 None] Created volume successfully. Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-3ab88ec3-648d-453a-af87-ace436548faa" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-3ab88ec3-648d-453a-af87-ace436548faa" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6d903-1ea1-4c24-b10d-7b5be1663098]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:14 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa Apr 21 20:59:14 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Flow 'volume_create_manager' (f4836154-1bbe-4050-855e-6bf49f9e12dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49562fae-c296-4353-bd1d-3ee279ab4fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49562fae-c296-4353-bd1d-3ee279ab4fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-154450412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c464ed8-32f5-4566-a4ba-40a8452ba575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356e7cb96dc34c488cbc46aceb68748b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:14Z,use_quota=True,user_id='6558781027094dedb5e47f4567846734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fc7945-e120-4682-b506-e2aac0aaeb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fc7945-e120-4682-b506-e2aac0aaeb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2862f4-eca7-47a7-a68b-4b7dbc651984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2862f4-eca7-47a7-a68b-4b7dbc651984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c464ed8-32f5-4566-a4ba-40a8452ba575', 'volume_name': 'volume-2c464ed8-32f5-4566-a4ba-40a8452ba575', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b5613b-ecc9-47f5-a6dd-2c8de3faff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b5613b-ecc9-47f5-a6dd-2c8de3faff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373256da-0f70-48cf-8118-20960db02f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:14 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Volume 2c464ed8-32f5-4566-a4ba-40a8452ba575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c464ed8-32f5-4566-a4ba-40a8452ba575', 'volume_size': 1} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-154450412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c464ed8-32f5-4566-a4ba-40a8452ba575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356e7cb96dc34c488cbc46aceb68748b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:14Z,use_quota=True,user_id='6558781027094dedb5e47f4567846734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Creating volume 2c464ed8-32f5-4566-a4ba-40a8452ba575 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:14 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:14 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 1073741824 Apr 21 20:59:14 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:14 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:14 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa Apr 21 20:59:14 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:14 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 1073741824" returned: 0 in 0.521s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:14 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 Apr 21 20:59:14 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:14 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3ab88ec3-648d-453a-af87-ace436548faa" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-3ab88ec3-648d-453a-af87-ace436548faa" released by "delete_volume" :: held 0.961s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['c4c800b2-ec94-4358-94b6-3737d0f8442c', 'fea10dfa-7e5b-44ae-b72c-33f9fcb95bb1', '284415d3-04ef-473a-b351-7a95971665ac', 'ae86682a-6d81-448c-82bc-0d55d1ff3637'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:15 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-450b14a8-1e67-4518-a9f7-d121504ae911-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-450b14a8-1e67-4518-a9f7-d121504ae911-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-450b14a8-1e67-4518-a9f7-d121504ae911" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-450b14a8-1e67-4518-a9f7-d121504ae911" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[03364adf-3569-46a0-83b9-316dc7984a14]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 Apr 21 20:59:15 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575" returned: 0 in 0.533s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373256da-0f70-48cf-8118-20960db02f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c464ed8-32f5-4566-a4ba-40a8452ba575', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da44c84-3379-4da0-8d87-e87c05434754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Volume volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 (2c464ed8-32f5-4566-a4ba-40a8452ba575): created successfully Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da44c84-3379-4da0-8d87-e87c05434754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Flow 'volume_create_manager' (f4836154-1bbe-4050-855e-6bf49f9e12dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:15 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5438770c-b169-45a1-bcd0-d17e011dfd06 tempest-VolumesMetadataTest-1415336771 None] Created volume successfully. Apr 21 20:59:15 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.521s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:15 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleted volume successfully. Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6c96a1a3-1580-4bac-97c0-1f9d9647f104 tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-3ab88ec3-648d-453a-af87-ace436548faa-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:15 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911" returned: 0 in 0.586s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911 Apr 21 20:59:15 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:16 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-450b14a8-1e67-4518-a9f7-d121504ae911" returned: 0 in 0.455s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-450b14a8-1e67-4518-a9f7-d121504ae911" released by "delete_volume" :: held 1.062s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['591ad0fa-795e-49c9-b398-3c825868eb42', '01ce9d24-ae91-47f5-abc5-0519adf37d88', '861b0a78-ab3a-4d8e-8a15-7ca6f84cf6d0', 'e6007c6f-ea9b-42f1-bcf2-78f92784e442'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:16 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:16 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:16 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:16 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleted volume successfully. Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4466a764-f3af-4f0f-971f-349ccd904e7c tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-450b14a8-1e67-4518-a9f7-d121504ae911-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Acquiring lock "cinder-2c464ed8-32f5-4566-a4ba-40a8452ba575-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Lock "cinder-2c464ed8-32f5-4566-a4ba-40a8452ba575-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Acquiring lock "cinder-quobyte-2c464ed8-32f5-4566-a4ba-40a8452ba575" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Lock "cinder-quobyte-2c464ed8-32f5-4566-a4ba-40a8452ba575" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842e3f6-744e-4efd-9474-6d8ef4442674]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 Apr 21 20:59:17 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-d17b976e-ad48-493e-8b3f-5446e0eebc36-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-d17b976e-ad48-493e-8b3f-5446e0eebc36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-f4b27bb2-1e78-4e15-972d-544fc5320a3d" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-f4b27bb2-1e78-4e15-972d-544fc5320a3d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-d17b976e-ad48-493e-8b3f-5446e0eebc36" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-d17b976e-ad48-493e-8b3f-5446e0eebc36" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleting offline snapshot d17b976e-ad48-493e-8b3f-5446e0eebc36 of volume f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] snapshot_file for this snap is: volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0748d23f-8717-43f8-bfe0-8b301b6d23a8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 Apr 21 20:59:17 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575 Apr 21 20:59:17 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36" returned: 0 in 0.478s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[300da2b9-5d26-44e6-95bf-f2e142d8cf3b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d Apr 21 20:59:17 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2c464ed8-32f5-4566-a4ba-40a8452ba575" returned: 0 in 0.438s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Lock "cinder-quobyte-2c464ed8-32f5-4566-a4ba-40a8452ba575" released by "delete_volume" :: held 1.017s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Created reservations ['c30e3da5-802d-4ebe-a490-6ddc4f35e9c1', 'd928541c-b3d0-4a91-a932-4ba3a6d701ae', '991610b5-3eb3-4b79-8071-d42156130f87', 'f868eb29-51d4-4e93-8c63-f32773aa7ada'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:18 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d" returned: 0 in 0.548s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 Apr 21 20:59:18 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.408s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:18 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Deleted volume successfully. Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3047c62-7187-4fe9-ba86-e44b4c3f7278 tempest-VolumesMetadataTest-1415336771 None] Lock "cinder-2c464ed8-32f5-4566-a4ba-40a8452ba575-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:18 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36" returned: 0 in 0.456s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36 Apr 21 20:59:18 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:19 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d.d17b976e-ad48-493e-8b3f-5446e0eebc36" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-d17b976e-ad48-493e-8b3f-5446e0eebc36" released by "_delete_snapshot" :: held 1.972s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-f4b27bb2-1e78-4e15-972d-544fc5320a3d" released by "delete_snapshot" :: held 1.984s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:19 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['33423c8f-6bf5-49fc-bb8c-3496e7b51fdd', '0c356093-6250-4452-911e-405fdd48ea3f', 'ed09acca-d02c-4846-b05b-52019041f3ae', 'cdc0dc0f-525d-410f-a1cc-1a8858594bdf'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:19 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Delete snapshot completed successfully. Apr 21 20:59:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cd9c2d1e-a1ac-4ab9-bc7e-08ccd44104fe tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-d17b976e-ad48-493e-8b3f-5446e0eebc36-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-f4b27bb2-1e78-4e15-972d-544fc5320a3d-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-f4b27bb2-1e78-4e15-972d-544fc5320a3d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "cinder-quobyte-f4b27bb2-1e78-4e15-972d-544fc5320a3d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-f4b27bb2-1e78-4e15-972d-544fc5320a3d" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:20 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[83acad09-6ccd-43a6-8917-3e54654502ab]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:20 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d Apr 21 20:59:20 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d" returned: 0 in 0.574s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:21 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d Apr 21 20:59:21 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f4b27bb2-1e78-4e15-972d-544fc5320a3d" returned: 0 in 0.582s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-quobyte-f4b27bb2-1e78-4e15-972d-544fc5320a3d" released by "delete_volume" :: held 1.201s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Created reservations ['a7fd7258-c516-475b-9c12-7f28397a7707', '8d622eac-f258-4182-a526-ceffd1124df0', 'e344a12c-460a-44e2-bdd6-7a5c4d4de963', '5fab1e39-3a1c-4bc2-8d64-fd4389fbb093'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:21 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:21 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Flow 'volume_create_manager' (5960b732-7671-4c20-bbfc-73d37362a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef76d4e-c6dd-458b-8b58-3a6809303fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef76d4e-c6dd-458b-8b58-3a6809303fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2081722572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc4958c-bbae-4861-933c-d5203d99001a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b1e386b7854f76ae3fa2fed6f0290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:22Z,use_quota=True,user_id='cc4ef04eec684fb2b8e19cceb91aff44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfac414-1801-4b56-b014-ecab323f6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfac414-1801-4b56-b014-ecab323f6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f7c082-7860-4e15-9d40-2331ec702867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f7c082-7860-4e15-9d40-2331ec702867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc4958c-bbae-4861-933c-d5203d99001a', 'volume_name': 'volume-6dc4958c-bbae-4861-933c-d5203d99001a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3366fb11-0d4d-4325-9a2d-d402a865e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3366fb11-0d4d-4325-9a2d-d402a865e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722468e1-50a3-45e7-864b-45d03195c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Volume 6dc4958c-bbae-4861-933c-d5203d99001a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc4958c-bbae-4861-933c-d5203d99001a', 'volume_size': 1} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2081722572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc4958c-bbae-4861-933c-d5203d99001a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b1e386b7854f76ae3fa2fed6f0290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:22Z,use_quota=True,user_id='cc4ef04eec684fb2b8e19cceb91aff44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Creating volume 6dc4958c-bbae-4861-933c-d5203d99001a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:22 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a 1073741824 Apr 21 20:59:22 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.532s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:22 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Deleted volume successfully. Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-83d5382b-bc4c-4ec0-bc28-4ed486e54cdb tempest-CreateVolumesFromSnapshotTest-1286774209 None] Lock "cinder-f4b27bb2-1e78-4e15-972d-544fc5320a3d-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:22 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a 1073741824" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a Apr 21 20:59:22 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:23 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a" returned: 0 in 0.499s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722468e1-50a3-45e7-864b-45d03195c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc4958c-bbae-4861-933c-d5203d99001a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379f718e-a7bd-4fc8-b374-56ae51cca01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:23 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Volume volume-6dc4958c-bbae-4861-933c-d5203d99001a (6dc4958c-bbae-4861-933c-d5203d99001a): created successfully Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379f718e-a7bd-4fc8-b374-56ae51cca01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Flow 'volume_create_manager' (5960b732-7671-4c20-bbfc-73d37362a42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:23 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-22136e61-4050-449d-9a4d-7577298fe33c tempest-VolumesTransfersTest-2120887866 None] Created volume successfully. Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (9e39133d-dc61-465d-be09-72b90f87c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bd6ef8-6d95-4b4e-a603-4d07910bf4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bd6ef8-6d95-4b4e-a603-4d07910bf4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708521330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e971336-7f0b-44d8-afd4-663374231d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:24Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca368ea9-a584-45e2-89e2-ff4ebbc93602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca368ea9-a584-45e2-89e2-ff4ebbc93602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e692da3e-293b-4bf9-a93b-571d7f674124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e692da3e-293b-4bf9-a93b-571d7f674124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e971336-7f0b-44d8-afd4-663374231d4a', 'volume_name': 'volume-8e971336-7f0b-44d8-afd4-663374231d4a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0fcb31-1b8d-482e-8486-1eb30ffa5ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0fcb31-1b8d-482e-8486-1eb30ffa5ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3180e989-f40f-4c3d-b919-adb9250200d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:24 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume 8e971336-7f0b-44d8-afd4-663374231d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e971336-7f0b-44d8-afd4-663374231d4a', 'volume_size': 1} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708521330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e971336-7f0b-44d8-afd4-663374231d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:24Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Creating volume 8e971336-7f0b-44d8-afd4-663374231d4a {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:24 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:24 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a 1073741824 Apr 21 20:59:24 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:24 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-caf6a20f-b79b-46ee-83f7-d9c99ae3ae41 tempest-VolumesTransfersTest-789705013 None] Transfer volume completed successfully. Apr 21 20:59:24 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a 1073741824" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:24 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a Apr 21 20:59:24 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Acquiring lock "cinder-6dc4958c-bbae-4861-933c-d5203d99001a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-6dc4958c-bbae-4861-933c-d5203d99001a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:25 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3180e989-f40f-4c3d-b919-adb9250200d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e971336-7f0b-44d8-afd4-663374231d4a', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0107de4d-7d9a-4aa9-b536-793dd54dccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:25 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume volume-8e971336-7f0b-44d8-afd4-663374231d4a (8e971336-7f0b-44d8-afd4-663374231d4a): created successfully Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0107de4d-7d9a-4aa9-b536-793dd54dccc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (9e39133d-dc61-465d-be09-72b90f87c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b58f9070-76dc-4565-82e7-a7aae7b8ba5d tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created volume successfully. Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Acquiring lock "cinder-quobyte-6dc4958c-bbae-4861-933c-d5203d99001a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-quobyte-6dc4958c-bbae-4861-933c-d5203d99001a" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59b29c7-2c6a-413d-b4aa-21a960f80c8e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:25 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a Apr 21 20:59:25 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:26 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a" returned: 0 in 0.516s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a Apr 21 20:59:26 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:26 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6dc4958c-bbae-4861-933c-d5203d99001a" returned: 0 in 0.406s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-quobyte-6dc4958c-bbae-4861-933c-d5203d99001a" released by "delete_volume" :: held 0.943s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Created reservations ['3fb912f5-e1fd-4174-b960-4a046583f2a4', 'e7aefc09-c128-46d3-a1a3-a7ad523035af', '3d543ac2-6efd-4dc1-b984-b09d9b383cd7', '23f137ea-9705-4efd-951d-033843cd2593'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:26 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (7f030219-d507-4fdf-aa57-aea9c60b47cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe90143-d26c-4166-bde7-14efc96ea802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe90143-d26c-4166-bde7-14efc96ea802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364439016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939ad8f4-6d27-4aa1-a698-74439579e9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664e53ae-d428-4af7-842c-d8097353c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664e53ae-d428-4af7-842c-d8097353c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c681f61e-966c-4ed9-bed7-46f23bd6f210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c681f61e-966c-4ed9-bed7-46f23bd6f210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939ad8f4-6d27-4aa1-a698-74439579e9ea', 'volume_name': 'volume-939ad8f4-6d27-4aa1-a698-74439579e9ea', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e1f9d3-830a-4ce5-82d4-d942e0be43c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e1f9d3-830a-4ce5-82d4-d942e0be43c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9a587-a4f5-4860-8b8f-ea913b241774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:26 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume 939ad8f4-6d27-4aa1-a698-74439579e9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939ad8f4-6d27-4aa1-a698-74439579e9ea', 'volume_size': 1} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364439016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939ad8f4-6d27-4aa1-a698-74439579e9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Creating volume 939ad8f4-6d27-4aa1-a698-74439579e9ea {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:26 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:27 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea 1073741824 Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:27 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Flow 'volume_create_manager' (8c52fe1d-a048-4b21-a789-b210adc0f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf534f3d-f4cb-47e9-a22d-08e2b279d56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf534f3d-f4cb-47e9-a22d-08e2b279d56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-915495662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095bcb89-007b-4cf0-ad00-6b3c36cea6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b1e386b7854f76ae3fa2fed6f0290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='cc4ef04eec684fb2b8e19cceb91aff44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ad162b-6cb4-4d96-a7d2-33e4717e9cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ad162b-6cb4-4d96-a7d2-33e4717e9cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc120987-ec0d-431d-be5a-677ae81b1006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc120987-ec0d-431d-be5a-677ae81b1006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095bcb89-007b-4cf0-ad00-6b3c36cea6e1', 'volume_name': 'volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6746f7-30cc-4ff0-afef-3e8f43d5fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6746f7-30cc-4ff0-afef-3e8f43d5fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7333bb-1ecc-40be-82b5-71f7042e5574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Volume 095bcb89-007b-4cf0-ad00-6b3c36cea6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1', 'volume_size': 1} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (584eb9c7-f0a4-4681-a7e5-1858ae9942ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51200e27-7a0f-462b-b877-7e230f285460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51200e27-7a0f-462b-b877-7e230f285460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989395103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f46ac1e-3dcc-4369-a371-ec63dee0aac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42761995-44c6-441b-953a-f43daa21f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42761995-44c6-441b-953a-f43daa21f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03edae3-a742-4ad2-8f8f-7aac5d22c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e03edae3-a742-4ad2-8f8f-7aac5d22c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f46ac1e-3dcc-4369-a371-ec63dee0aac5', 'volume_name': 'volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2724b768-fdb9-473e-b2bd-a23692e3f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2724b768-fdb9-473e-b2bd-a23692e3f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d446b21-c071-4b4f-b70b-0a778db7435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume 8f46ac1e-3dcc-4369-a371-ec63dee0aac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5', 'volume_size': 1} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:27 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 1.044s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Deleted volume successfully. Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c3312dc6-ef76-4595-8213-48299bbb713f tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-6dc4958c-bbae-4861-933c-d5203d99001a-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (f1c8b0c2-9219-4379-8eea-7ad920b3a8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b5c3dc-dc37-44e9-a623-3a4db9238336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b5c3dc-dc37-44e9-a623-3a4db9238336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315218276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29fd0f2-edf3-4f1c-96cd-c4388054bf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:28Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125ba0a9-d6fd-45a0-8889-b671616f8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125ba0a9-d6fd-45a0-8889-b671616f8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dee6a29-eeb6-4c32-971d-31af5bc5e6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dee6a29-eeb6-4c32-971d-31af5bc5e6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29fd0f2-edf3-4f1c-96cd-c4388054bf75', 'volume_name': 'volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae88611-df51-4451-bda7-421db0c43424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae88611-df51-4451-bda7-421db0c43424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5febeaf4-fd8a-43cd-8f75-56a302902bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume c29fd0f2-edf3-4f1c-96cd-c4388054bf75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75', 'volume_size': 1} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:27 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (0c981c35-bbe5-4b73-a2b3-439ff44ddad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358e5105-1ad7-4e7c-921c-d836ed2d4368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358e5105-1ad7-4e7c-921c-d836ed2d4368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947915334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc95f195-e6ee-4fad-9ba7-99eecb0441e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:28Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d57b98-7fdf-40a7-8749-5571ab06b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d57b98-7fdf-40a7-8749-5571ab06b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad724c1-fb21-4a87-a34c-cb97e6e2889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad724c1-fb21-4a87-a34c-cb97e6e2889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc95f195-e6ee-4fad-9ba7-99eecb0441e7', 'volume_name': 'volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fccab4a-e1ca-476e-aeb0-56e0044878d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fccab4a-e1ca-476e-aeb0-56e0044878d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d961a3-3a0f-41e6-96fb-dc2c452bc82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume bc95f195-e6ee-4fad-9ba7-99eecb0441e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7', 'volume_size': 1} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:28 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea 1073741824" returned: 0 in 1.174s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea Apr 21 20:59:28 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (3fb1f383-92a5-4136-999f-965aecf302a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6205315d-b59e-420f-bd4a-fdda744845da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6205315d-b59e-420f-bd4a-fdda744845da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602446298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51aff25-4b0f-4a2e-a521-93f961ca2fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:28Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8538390b-542d-456f-b2d2-2516c2eb2fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8538390b-542d-456f-b2d2-2516c2eb2fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22e5ba3-5c50-40a4-a4c0-58b89d66bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22e5ba3-5c50-40a4-a4c0-58b89d66bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51aff25-4b0f-4a2e-a521-93f961ca2fc8', 'volume_name': 'volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825e25cc-6671-420c-b2cc-5d3b8ea12245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825e25cc-6671-420c-b2cc-5d3b8ea12245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa0af00-e380-4703-95b5-c9f713a75f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume f51aff25-4b0f-4a2e-a521-93f961ca2fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8', 'volume_size': 1} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:28 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea" returned: 0 in 0.529s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-915495662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095bcb89-007b-4cf0-ad00-6b3c36cea6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b1e386b7854f76ae3fa2fed6f0290b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='cc4ef04eec684fb2b8e19cceb91aff44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Creating volume 095bcb89-007b-4cf0-ad00-6b3c36cea6e1 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:28 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9a587-a4f5-4860-8b8f-ea913b241774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939ad8f4-6d27-4aa1-a698-74439579e9ea', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 1073741824 Apr 21 20:59:28 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11381839-bcbf-40a3-9765-e1ca526567df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume volume-939ad8f4-6d27-4aa1-a698-74439579e9ea (939ad8f4-6d27-4aa1-a698-74439579e9ea): created successfully Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11381839-bcbf-40a3-9765-e1ca526567df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (7f030219-d507-4fdf-aa57-aea9c60b47cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:28 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c79b07e9-e865-4b7a-a09f-6f92fd7d4f78 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created volume successfully. Apr 21 20:59:29 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 1073741824" returned: 0 in 0.527s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 Apr 21 20:59:29 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:29 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1" returned: 0 in 0.425s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989395103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f46ac1e-3dcc-4369-a371-ec63dee0aac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Creating volume 8f46ac1e-3dcc-4369-a371-ec63dee0aac5 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:29 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7333bb-1ecc-40be-82b5-71f7042e5574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057264b9-bbc8-465f-960d-1bd8091e6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:29 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 1073741824 Apr 21 20:59:29 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:29 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Volume volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 (095bcb89-007b-4cf0-ad00-6b3c36cea6e1): created successfully Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057264b9-bbc8-465f-960d-1bd8091e6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Flow 'volume_create_manager' (8c52fe1d-a048-4b21-a789-b210adc0f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-bd1cf94b-f676-41a4-a523-0e04a970df1b tempest-VolumesTransfersTest-2120887866 None] Created volume successfully. Apr 21 20:59:30 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 1073741824" returned: 0 in 0.648s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 Apr 21 20:59:30 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Acquiring lock "cinder-095bcb89-007b-4cf0-ad00-6b3c36cea6e1-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-095bcb89-007b-4cf0-ad00-6b3c36cea6e1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Acquiring lock "cinder-quobyte-095bcb89-007b-4cf0-ad00-6b3c36cea6e1" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-quobyte-095bcb89-007b-4cf0-ad00-6b3c36cea6e1" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ac60e2-e5d4-49db-a4e0-97c958154ffa]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 Apr 21 20:59:30 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.014s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315218276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29fd0f2-edf3-4f1c-96cd-c4388054bf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:28Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Creating volume c29fd0f2-edf3-4f1c-96cd-c4388054bf75 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:30 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 1073741824 Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d446b21-c071-4b4f-b70b-0a778db7435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:30 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8debb58-2c95-4ced-bb31-b50736a59209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:30 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 (8f46ac1e-3dcc-4369-a371-ec63dee0aac5): created successfully Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8debb58-2c95-4ced-bb31-b50736a59209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (584eb9c7-f0a4-4681-a7e5-1858ae9942ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:30 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-74eefcd5-a4d3-44da-b079-e829d3ce8415 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created volume successfully. Apr 21 20:59:31 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1" returned: 0 in 0.557s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1 Apr 21 20:59:31 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 1073741824" returned: 0 in 0.725s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=194,cinder:INSERT=75,cinder:UPDATE=249,cinder:DELETE=20 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 Apr 21 20:59:31 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095bcb89-007b-4cf0-ad00-6b3c36cea6e1" returned: 0 in 0.548s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-quobyte-095bcb89-007b-4cf0-ad00-6b3c36cea6e1" released by "delete_volume" :: held 1.132s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Created reservations ['be12ccd3-5e8b-4822-9366-9099f6008bc4', '25892dc1-2b33-46f4-b6ee-f20c997ce9f3', '7a3513a2-0edf-45c2-87ba-49763987642b', 'b9c6501b-e3eb-4b26-80c0-8b1b35b26c0a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:31 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947915334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc95f195-e6ee-4fad-9ba7-99eecb0441e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:28Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Creating volume bc95f195-e6ee-4fad-9ba7-99eecb0441e7 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:32 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5febeaf4-fd8a-43cd-8f75-56a302902bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b1620a-b4cc-4b15-a9cf-a1870d350823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:32 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 1073741824 Apr 21 20:59:32 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 (c29fd0f2-edf3-4f1c-96cd-c4388054bf75): created successfully Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b1620a-b4cc-4b15-a9cf-a1870d350823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (f1c8b0c2-9219-4379-8eea-7ad920b3a8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-90946901-c170-4f43-ab2d-fff861529a1c tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created volume successfully. Apr 21 20:59:32 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.456s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Deleted volume successfully. Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b3cba1c7-be80-44d0-b219-ffb9f9a85317 tempest-VolumesTransfersTest-1502950427 None] Lock "cinder-095bcb89-007b-4cf0-ad00-6b3c36cea6e1-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:32 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 1073741824" returned: 0 in 0.681s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:32 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 Apr 21 20:59:32 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:33 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.973s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602446298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51aff25-4b0f-4a2e-a521-93f961ca2fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6f4ed6a253411298368113aa0fbfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:28Z,use_quota=True,user_id='79eaace2682044b3adb26c4e6b5a848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Creating volume f51aff25-4b0f-4a2e-a521-93f961ca2fc8 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:33 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d961a3-3a0f-41e6-96fb-dc2c452bc82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:33 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 1073741824 Apr 21 20:59:33 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d63e066-79c4-4385-a931-37ebbc73b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:33 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 (bc95f195-e6ee-4fad-9ba7-99eecb0441e7): created successfully Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d63e066-79c4-4385-a931-37ebbc73b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (0c981c35-bbe5-4b73-a2b3-439ff44ddad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:33 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-868f3a33-e0d6-46af-9ede-d61cf2ddfa91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created volume successfully. Apr 21 20:59:33 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 1073741824" returned: 0 in 0.619s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 Apr 21 20:59:33 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8" returned: 0 in 0.492s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa0af00-e380-4703-95b5-c9f713a75f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f929a52-8e44-40f2-bc79-412d8a412821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:34 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Volume volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 (f51aff25-4b0f-4a2e-a521-93f961ca2fc8): created successfully Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f929a52-8e44-40f2-bc79-412d8a412821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Flow 'volume_create_manager' (3fb1f383-92a5-4136-999f-965aecf302a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b1fe9973-ddc4-45ec-886d-d69f71f88b91 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created volume successfully. Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-f51aff25-4b0f-4a2e-a521-93f961ca2fc8-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-f51aff25-4b0f-4a2e-a521-93f961ca2fc8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-quobyte-f51aff25-4b0f-4a2e-a521-93f961ca2fc8" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-f51aff25-4b0f-4a2e-a521-93f961ca2fc8" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb779a8-cd73-47fd-b0d5-a6ab68645364]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 Apr 21 20:59:34 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8" returned: 0 in 0.554s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8 Apr 21 20:59:35 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f51aff25-4b0f-4a2e-a521-93f961ca2fc8" returned: 0 in 0.552s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-f51aff25-4b0f-4a2e-a521-93f961ca2fc8" released by "delete_volume" :: held 1.132s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created reservations ['08b1767a-9860-42c4-b6b3-80a3f09e4256', 'e2e6e4a3-41fb-43a6-a365-b65184b64fe7', '73894b7a-b091-43cb-9943-7630d9b15fca', '1deb1c2d-9632-4142-91a0-b0ab316305e1'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:36 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Flow 'volume_create_manager' (e280a6f2-6214-4768-87de-89dece97460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d05aea-26e6-4bbf-a8d3-5cbed6ec80cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d05aea-26e6-4bbf-a8d3-5cbed6ec80cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-73837234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddb5204-fe55-4f96-9f5d-2ffee82ec60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3235334a68824903a43dba7da8fccd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:36Z,use_quota=True,user_id='5691155ac963494dbe339ea150c3afc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7bb850-1af0-4c7b-b485-991763089e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7bb850-1af0-4c7b-b485-991763089e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a83b2-5834-4b0a-af07-c8471db4b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a83b2-5834-4b0a-af07-c8471db4b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'volume_name': 'volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f0ae3d-3795-4701-afff-1e04935783f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f0ae3d-3795-4701-afff-1e04935783f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052272b5-7555-4de5-b8ed-f6d00abdbac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Volume eddb5204-fe55-4f96-9f5d-2ffee82ec60e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'volume_size': 1} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-73837234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddb5204-fe55-4f96-9f5d-2ffee82ec60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3235334a68824903a43dba7da8fccd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:36Z,use_quota=True,user_id='5691155ac963494dbe339ea150c3afc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Creating volume eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:36 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e 1073741824 Apr 21 20:59:36 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:36 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.412s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:36 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Deleted volume successfully. Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-873e1386-b154-4bfe-b6a0-b6cc56972afe tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-f51aff25-4b0f-4a2e-a521-93f961ca2fc8-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:36 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e 1073741824" returned: 0 in 0.513s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:36 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-bc95f195-e6ee-4fad-9ba7-99eecb0441e7-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-bc95f195-e6ee-4fad-9ba7-99eecb0441e7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-quobyte-bc95f195-e6ee-4fad-9ba7-99eecb0441e7" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-bc95f195-e6ee-4fad-9ba7-99eecb0441e7" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d61e2c-e992-4a5d-900e-b90663ad7b5e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:37 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 Apr 21 20:59:37 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:37 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.517s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052272b5-7555-4de5-b8ed-f6d00abdbac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a12362b-f3c1-4ae1-bb6d-5c8f44acd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:37 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Volume volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e (eddb5204-fe55-4f96-9f5d-2ffee82ec60e): created successfully Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a12362b-f3c1-4ae1-bb6d-5c8f44acd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Flow 'volume_create_manager' (e280a6f2-6214-4768-87de-89dece97460e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:37 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-63264598-2898-4800-9b54-cf94cd663198 tempest-VolumesCloneTest-482303263 None] Created volume successfully. Apr 21 20:59:37 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7" returned: 0 in 0.587s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:37 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7 Apr 21 20:59:37 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:38 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bc95f195-e6ee-4fad-9ba7-99eecb0441e7" returned: 0 in 0.480s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-bc95f195-e6ee-4fad-9ba7-99eecb0441e7" released by "delete_volume" :: held 1.107s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created reservations ['1e3b4696-2027-4667-994c-1ae43ad33283', 'a71dc24a-a6a6-48b8-b51c-5855b76dea38', '9f5c6110-fb70-4356-b99e-d42e873947a2', '6273f6d2-7386-4e01-bee0-fd2bc2b85c3e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:38 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Flow 'volume_create_manager' (d04399b5-18f0-460e-8dde-bd34cf643a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e823ffbf-f327-4455-b84c-8f74a1a86b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e823ffbf-f327-4455-b84c-8f74a1a86b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2145990411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e3b895-37ae-48e5-bcf7-e3f95c23eee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3235334a68824903a43dba7da8fccd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eddb5204-fe55-4f96-9f5d-2ffee82ec60e,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:39Z,use_quota=True,user_id='5691155ac963494dbe339ea150c3afc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ac0592-bdbd-4a9c-a6c2-2fc77c5167e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ac0592-bdbd-4a9c-a6c2-2fc77c5167e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32478ce9-1d6c-4d31-9feb-ba9971e0177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32478ce9-1d6c-4d31-9feb-ba9971e0177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '77e3b895-37ae-48e5-bcf7-e3f95c23eee5', 'volume_name': 'volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5', 'volume_size': 2, 'source_volid': 'eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61487e4a-d769-415a-9929-999ea0ff0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61487e4a-d769-415a-9929-999ea0ff0dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b095dc9c-d4e9-4bdd-9c4d-b6733b85ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Volume 77e3b895-37ae-48e5-bcf7-e3f95c23eee5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5', 'volume_size': 2, 'source_volid': 'eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'source_volstatus': 'available'} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:38 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Cloning volume eddb5204-fe55-4f96-9f5d-2ffee82ec60e to volume 77e3b895-37ae-48e5-bcf7-e3f95c23eee5 Apr 21 20:59:38 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.551s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Creating offline snapshot 16432654-f24f-4e4a-af47-a282565f989a of volume eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Deleted volume successfully. Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[609a3918-6ee5-4efa-b03a-8682a6c5f867]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-53abd176-0e09-46f6-9800-02279d89a427 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-bc95f195-e6ee-4fad-9ba7-99eecb0441e7-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:38 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:38 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-c29fd0f2-edf3-4f1c-96cd-c4388054bf75-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-c29fd0f2-edf3-4f1c-96cd-c4388054bf75-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-quobyte-c29fd0f2-edf3-4f1c-96cd-c4388054bf75" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-c29fd0f2-edf3-4f1c-96cd-c4388054bf75" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13735a6-549c-4ee8-ad35-541b0bd066e3]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 Apr 21 20:59:39 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.533s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a 1G Apr 21 20:59:39 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75" returned: 0 in 0.591s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75 Apr 21 20:59:39 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a 1G" returned: 0 in 0.559s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a Apr 21 20:59:39 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:40 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c29fd0f2-edf3-4f1c-96cd-c4388054bf75" returned: 0 in 0.519s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-c29fd0f2-edf3-4f1c-96cd-c4388054bf75" released by "delete_volume" :: held 1.142s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created reservations ['65bf6d75-4352-49ac-8ac0-edc71f71f00e', '7193274d-270d-4977-8a71-284ea781c4c1', '74833445-62c3-44e0-aeb3-08bd1a1f7c93', '155caeba-e658-4077-9bdc-e2675680bb50'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:40 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a" returned: 0 in 0.532s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:40 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a is being set with open permissions: ugo+rw Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:40 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a Apr 21 20:59:40 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:40 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:40 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:40 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.453s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:40 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Deleted volume successfully. Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-a92a3d8b-195c-4fa2-b776-b269b7240917 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-c29fd0f2-edf3-4f1c-96cd-c4388054bf75-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:41 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a" returned: 0 in 0.558s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info Apr 21 20:59:41 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Acquiring lock "cinder-b5eccb96-7b20-4483-8757-900086d0a975-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Lock "cinder-b5eccb96-7b20-4483-8757-900086d0a975-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Acquiring lock "cinder-quobyte-b5eccb96-7b20-4483-8757-900086d0a975" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Lock "cinder-quobyte-b5eccb96-7b20-4483-8757-900086d0a975" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[15df80ed-bb4e-4453-a808-a017bdb08787]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 Apr 21 20:59:41 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-8f46ac1e-3dcc-4369-a371-ec63dee0aac5-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-8f46ac1e-3dcc-4369-a371-ec63dee0aac5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-quobyte-8f46ac1e-3dcc-4369-a371-ec63dee0aac5" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-8f46ac1e-3dcc-4369-a371-ec63dee0aac5" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[20404365-4167-421a-95f9-a848d75b9900]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info" returned: 0 in 0.472s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info is being set with open permissions: ugo+rw Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 Apr 21 20:59:41 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info Apr 21 20:59:41 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975 Apr 21 20:59:41 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.info" returned: 0 in 0.436s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Acquiring lock "cinder-quobyte-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] snapshot: 16432654-f24f-4e4a-af47-a282565f989a, volume: 77e3b895-37ae-48e5-bcf7-e3f95c23eee5, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:59:41 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5 Apr 21 20:59:41 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a2ee78-1335-48c7-a74a-48372009ab90]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:42 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-b5eccb96-7b20-4483-8757-900086d0a975" returned: 0 in 0.417s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Lock "cinder-quobyte-b5eccb96-7b20-4483-8757-900086d0a975" released by "delete_volume" :: held 0.908s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:42 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a Apr 21 20:59:42 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Created reservations ['3044e4d7-b0ed-466d-9929-4ca74e1a2b65', '715f64a3-f17b-43f3-a4ab-07bd9e148d9b', '168dd78c-a050-42fd-b31b-8a536c3b1b34', 'd4883722-fa80-45e9-a19f-bb45ef9e4dc0'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:42 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:42 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:42 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8f46ac1e-3dcc-4369-a371-ec63dee0aac5" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-8f46ac1e-3dcc-4369-a371-ec63dee0aac5" released by "delete_volume" :: held 0.979s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created reservations ['971c618a-cbbe-4f79-8ce0-621e005781c1', 'bc09cc5c-29d5-496a-8f6c-60cc56ab26bd', '6d7680c5-9ddf-4c7c-b575-a59f4173d1a1', '6e1e305c-4ebe-4f81-b52d-dea14851f041'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:42 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:42 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:42 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Deleted volume successfully. Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f37b8-1b17-475e-b346-9cce75839436]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:42 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:42 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4cd534a-6979-4d7f-808e-74820652394f tempest-VolumesNegativeTest-879121881 None] Lock "cinder-b5eccb96-7b20-4483-8757-900086d0a975-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:42 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:42 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:43 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.477s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Deleted volume successfully. Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8a8d98c7-8cfe-4cc4-8d29-2ce3e8dbb088 tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-8f46ac1e-3dcc-4369-a371-ec63dee0aac5-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:43 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.587s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:43 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 Apr 21 20:59:43 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-939ad8f4-6d27-4aa1-a698-74439579e9ea-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-939ad8f4-6d27-4aa1-a698-74439579e9ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-quobyte-939ad8f4-6d27-4aa1-a698-74439579e9ea" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-939ad8f4-6d27-4aa1-a698-74439579e9ea" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0594223e-8efe-459f-b083-12334fa48109]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:43 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea Apr 21 20:59:43 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Flow 'volume_create_manager' (27f88caa-f896-4bae-8595-2c67160f0307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb4840d-056f-4e50-a0cc-91d5962d12ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb4840d-056f-4e50-a0cc-91d5962d12ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6611b4a-06a4-4653-b35f-ceead95df06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e4a1814ca246f7bf373538738a65df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:44Z,use_quota=True,user_id='27772fe6ee2f436981e4cf8f96065e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d446fed1-8fb7-47fd-bb22-d3af41d708c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d446fed1-8fb7-47fd-bb22-d3af41d708c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8542f3ab-5e5c-485a-84a4-2f1bd1540f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8542f3ab-5e5c-485a-84a4-2f1bd1540f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6611b4a-06a4-4653-b35f-ceead95df06c', 'volume_name': 'volume-c6611b4a-06a4-4653-b35f-ceead95df06c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cf5fb0-a01f-4fd9-8d1b-dd19d5417ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cf5fb0-a01f-4fd9-8d1b-dd19d5417ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d228fa-df9a-44f6-a0de-76c761677981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:44 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Volume c6611b4a-06a4-4653-b35f-ceead95df06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6611b4a-06a4-4653-b35f-ceead95df06c', 'volume_size': 1} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:44 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea" returned: 0 in 1.242s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:44 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea Apr 21 20:59:44 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:45 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" returned: 0 in 2.306s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad468f14-866e-4d85-9a68-d3fb3fa2c6b8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:45 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:45 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:45 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-939ad8f4-6d27-4aa1-a698-74439579e9ea" returned: 0 in 0.762s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-939ad8f4-6d27-4aa1-a698-74439579e9ea" released by "delete_volume" :: held 2.038s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created reservations ['6200342a-c441-4cc7-887c-feaf444fd914', '0dae4173-54e0-4571-8f66-41b378e45a5e', '639dab0a-d553-405b-b216-f1314db5c770', '8fe529a4-3d8b-4ccb-bb13-15c10aab4c10'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:45 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:45 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-8e971336-7f0b-44d8-afd4-663374231d4a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-8e971336-7f0b-44d8-afd4-663374231d4a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "cinder-quobyte-8e971336-7f0b-44d8-afd4-663374231d4a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-8e971336-7f0b-44d8-afd4-663374231d4a" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d49cfb6-d8e5-42ed-8a4f-6d3ad3523513]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a Apr 21 20:59:46 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:46 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.693s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:59:46 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Converted 1024.00 MB image at 443.75 MB/s Apr 21 20:59:46 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 is being set with open permissions: ugo+rw Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 Apr 21 20:59:46 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:46 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Deleted volume successfully. Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f89188ca-3206-4a20-91bb-3c3803cb225b tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-939ad8f4-6d27-4aa1-a698-74439579e9ea-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:46 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a" returned: 0 in 0.485s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a Apr 21 20:59:46 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:46 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" returned: 0 in 0.421s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" released by "_copy_volume_from_snapshot" :: held 4.631s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Acquiring lock "cinder-quobyte-16432654-f24f-4e4a-af47-a282565f989a" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-16432654-f24f-4e4a-af47-a282565f989a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Deleting offline snapshot 16432654-f24f-4e4a-af47-a282565f989a of volume eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] snapshot_file for this snap is: volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb065952-53b0-40a4-a520-4350b5fb03a8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a Apr 21 20:59:46 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:46 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-8e971336-7f0b-44d8-afd4-663374231d4a" returned: 0 in 0.436s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-quobyte-8e971336-7f0b-44d8-afd4-663374231d4a" released by "delete_volume" :: held 0.947s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Created reservations ['82243a59-c4ec-4649-934e-a437718d9445', '46df889c-c230-495e-9045-b6a3c4768d77', '421c5c5e-d1f3-4d26-8e9a-e7d10c38f9fd', '743a905b-0685-41b2-98f6-a179e6f52b7c'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:46 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:46 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:47 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a" returned: 0 in 0.542s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1d0f92-e81e-4f63-bc62-768d996608f3]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:47 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:47 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:47 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:47 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Deleted volume successfully. Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6fecd6b-e190-4809-a226-37003f353cdd tempest-CreateVolumesFromSourceVolumeTest-54574174 None] Lock "cinder-8e971336-7f0b-44d8-afd4-663374231d4a-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:47 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.552s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:47 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a Apr 21 20:59:47 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a" returned: 0 in 0.560s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a Apr 21 20:59:48 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (416f1729-a7c8-4aba-aec9-33fbc55737b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8356cd2c-5974-4178-94a5-251bc6ca52db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8356cd2c-5974-4178-94a5-251bc6ca52db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-185235815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925f4b0f-9f5a-48e1-829f-3f56256a589b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31f5dec3ddf4f09817cf69619b6762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:49Z,use_quota=True,user_id='99fe9151817b4ed4ae7bad9b759c8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175688b3-6314-486b-accf-ddee44717a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175688b3-6314-486b-accf-ddee44717a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367f1056-908d-4628-b5a7-c1bdaa51cd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367f1056-908d-4628-b5a7-c1bdaa51cd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925f4b0f-9f5a-48e1-829f-3f56256a589b', 'volume_name': 'volume-925f4b0f-9f5a-48e1-829f-3f56256a589b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49fb54e-3c4d-4a62-9dd7-c315cebbf6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49fb54e-3c4d-4a62-9dd7-c315cebbf6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87098951-02d6-4c66-875d-12d79771c059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Volume 925f4b0f-9f5a-48e1-829f-3f56256a589b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925f4b0f-9f5a-48e1-829f-3f56256a589b', 'volume_size': 1} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:48 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e.16432654-f24f-4e4a-af47-a282565f989a" returned: 0 in 0.460s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-16432654-f24f-4e4a-af47-a282565f989a" released by "_delete_snapshot" :: held 2.155s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.056s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.322s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6611b4a-06a4-4653-b35f-ceead95df06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e4a1814ca246f7bf373538738a65df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:44Z,use_quota=True,user_id='27772fe6ee2f436981e4cf8f96065e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Creating volume c6611b4a-06a4-4653-b35f-ceead95df06c {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:48 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b095dc9c-d4e9-4bdd-9c4d-b6733b85ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5', 'volume_size': 2, 'source_volid': 'eddb5204-fe55-4f96-9f5d-2ffee82ec60e', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c 1073741824 Apr 21 20:59:48 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae551804-c82b-44c9-bc37-3db145f9d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Volume volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 (77e3b895-37ae-48e5-bcf7-e3f95c23eee5): created successfully Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae551804-c82b-44c9-bc37-3db145f9d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Flow 'volume_create_manager' (d04399b5-18f0-460e-8dde-bd34cf643a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-058cccaa-64ca-4fd3-94cc-f83cf9f023be tempest-VolumesCloneTest-482303263 None] Created volume successfully. Apr 21 20:59:49 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c 1073741824" returned: 0 in 0.457s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c Apr 21 20:59:49 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Acquiring lock "cinder-77e3b895-37ae-48e5-bcf7-e3f95c23eee5-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Lock "cinder-77e3b895-37ae-48e5-bcf7-e3f95c23eee5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Acquiring lock "cinder-quobyte-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[432a0391-1d5d-4caa-a494-d4c347fff01b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 Apr 21 20:59:49 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-185235815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925f4b0f-9f5a-48e1-829f-3f56256a589b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31f5dec3ddf4f09817cf69619b6762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:49Z,use_quota=True,user_id='99fe9151817b4ed4ae7bad9b759c8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Creating volume 925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:49 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d228fa-df9a-44f6-a0de-76c761677981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6611b4a-06a4-4653-b35f-ceead95df06c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b 1073741824 Apr 21 20:59:49 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b50908-dd58-4fed-8da5-ceafc9e1a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Volume volume-c6611b4a-06a4-4653-b35f-ceead95df06c (c6611b4a-06a4-4653-b35f-ceead95df06c): created successfully Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b50908-dd58-4fed-8da5-ceafc9e1a19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Flow 'volume_create_manager' (27f88caa-f896-4bae-8595-2c67160f0307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:49 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4a36955b-a8ed-4158-bf95-2fcfe106e5d9 tempest-CinderUnicodeTest-1939934152 None] Created volume successfully. Apr 21 20:59:49 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" returned: 0 in 0.478s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5 Apr 21 20:59:49 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b 1073741824" returned: 0 in 0.542s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 20:59:50 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" returned: 0 in 0.457s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-77e3b895-37ae-48e5-bcf7-e3f95c23eee5" released by "delete_volume" :: held 0.962s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Created reservations ['c123275f-aaa2-435a-baa6-125f8a5d4029', 'fea638d4-af46-49c7-bb62-d18e47c63460', '6235218f-f62e-4463-8b11-fc20c71032c5', '9afe58a5-3d40-41fa-b1f5-c3e3ccdb3622'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:50 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Flow 'volume_create_manager' (5ed2d43e-e2bf-4d74-b996-6778e75ab848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b878ab-6e9a-47fe-859c-57a60099e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b878ab-6e9a-47fe-859c-57a60099e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1569607283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7446f7-75d4-47e7-89f7-ba13ac6ea813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e4a1814ca246f7bf373538738a65df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='27772fe6ee2f436981e4cf8f96065e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628793ff-e0b5-4486-bf54-14911c3676a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628793ff-e0b5-4486-bf54-14911c3676a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd86789-8190-4062-942f-66a87c598a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd86789-8190-4062-942f-66a87c598a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7446f7-75d4-47e7-89f7-ba13ac6ea813', 'volume_name': 'volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2572806a-9478-4809-b0d8-32fbc99c6e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2572806a-9478-4809-b0d8-32fbc99c6e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab96a3bd-4d93-41d4-a98b-ec8dc72cc0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Volume ae7446f7-75d4-47e7-89f7-ba13ac6ea813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813', 'volume_size': 1} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Acquiring lock "cinder-eddb5204-fe55-4f96-9f5d-2ffee82ec60e-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Lock "cinder-eddb5204-fe55-4f96-9f5d-2ffee82ec60e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Acquiring lock "cinder-quobyte-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e0c58f-4bca-454c-9a33-1e7aea5233bc]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:50 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.485s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1569607283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7446f7-75d4-47e7-89f7-ba13ac6ea813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e4a1814ca246f7bf373538738a65df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='27772fe6ee2f436981e4cf8f96065e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Creating volume ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:50 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87098951-02d6-4c66-875d-12d79771c059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925f4b0f-9f5a-48e1-829f-3f56256a589b', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 1073741824 Apr 21 20:59:50 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e8d85d-190b-4742-acee-c2128d19a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Volume volume-925f4b0f-9f5a-48e1-829f-3f56256a589b (925f4b0f-9f5a-48e1-829f-3f56256a589b): created successfully Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e8d85d-190b-4742-acee-c2128d19a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (416f1729-a7c8-4aba-aec9-33fbc55737b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:50 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b46eadfb-25ce-4a14-aeec-73b4e79941af tempest-VolumeDependencyTests-2051825396 None] Created volume successfully. Apr 21 20:59:50 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:50 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Deleted volume successfully. Apr 21 20:59:50 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fee40bd2-b16e-4ea0-a896-9dd5ebddb07b tempest-VolumesCloneTest-482303263 None] Lock "cinder-77e3b895-37ae-48e5-bcf7-e3f95c23eee5-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:51 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.509s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:51 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e Apr 21 20:59:51 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:51 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 1073741824" returned: 0 in 0.479s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:51 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 Apr 21 20:59:51 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:51 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" returned: 0 in 0.439s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Lock "cinder-quobyte-eddb5204-fe55-4f96-9f5d-2ffee82ec60e" released by "delete_volume" :: held 0.975s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Created reservations ['d2bf1719-318e-44fb-a1fd-466a919cd7b2', '22924ecf-33c1-4657-b9b6-0c8bfb60a29f', 'a3db372e-a508-4ce8-bfad-67380e8bce4c', 'c8c20fb8-33ad-495a-bbbf-15bffd55ab2a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:51 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 20:59:51 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:51 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" returned: 0 in 0.495s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab96a3bd-4d93-41d4-a98b-ec8dc72cc0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1aa1cc-ee12-45dd-9946-9692ebc20ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Volume volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 (ae7446f7-75d4-47e7-89f7-ba13ac6ea813): created successfully Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1aa1cc-ee12-45dd-9946-9692ebc20ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Flow 'volume_create_manager' (5ed2d43e-e2bf-4d74-b996-6778e75ab848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c3a02134-6be3-4a8c-9311-713614ce2687 tempest-CinderUnicodeTest-1939934152 None] Created volume successfully. Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Creating offline snapshot 9288340e-0942-4a4c-9786-0785e00c2fc8 of volume 925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd2e5a3-5730-4377-ba2c-56fc8a00b007]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 20:59:52 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:52 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Deleted volume successfully. Apr 21 20:59:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9bcee13a-4007-4907-a976-b807336bf175 tempest-VolumesCloneTest-482303263 None] Lock "cinder-eddb5204-fe55-4f96-9f5d-2ffee82ec60e-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:52 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.504s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 1G Apr 21 20:59:52 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:53 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 1G" returned: 0 in 0.572s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925f4b0f-9f5a-48e1-829f-3f56256a589b -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925f4b0f-9f5a-48e1-829f-3f56256a589b -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 Apr 21 20:59:53 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925f4b0f-9f5a-48e1-829f-3f56256a589b -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8" returned: 0 in 0.528s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 is being set with open permissions: ugo+rw Apr 21 20:59:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 Apr 21 20:59:53 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:54 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:54 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info Apr 21 20:59:54 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:54 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:54 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info is being set with open permissions: ugo+rw Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:54 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info Apr 21 20:59:54 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Flow 'volume_create_manager' (536ca5ab-bfd8-4c7c-bf2b-fe6698ce8a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d7c0bc-4fe6-4223-a2e7-97484f2f679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d7c0bc-4fe6-4223-a2e7-97484f2f679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-729993019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7f1921-0012-481a-8d71-81f945a17b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cfdbcfa744cdfae2c22112aa221e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:55Z,use_quota=True,user_id='4ca855a944e44b8e98c63cb82bfa2782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f28dff-fb8d-4e98-bab3-4744a6caf463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f28dff-fb8d-4e98-bab3-4744a6caf463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249e5783-b6fb-4b90-a6fa-a84abbf75a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249e5783-b6fb-4b90-a6fa-a84abbf75a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7f1921-0012-481a-8d71-81f945a17b5f', 'volume_name': 'volume-ca7f1921-0012-481a-8d71-81f945a17b5f', 'volume_size': 2}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1d7b69-c67b-4843-8997-542b01f39feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1d7b69-c67b-4843-8997-542b01f39feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7278f378-e405-4333-9db9-8aa420e7b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:54 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Volume ca7f1921-0012-481a-8d71-81f945a17b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7f1921-0012-481a-8d71-81f945a17b5f', 'volume_size': 2} Apr 21 20:59:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:55 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.info" returned: 0 in 0.485s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.169s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Creating offline snapshot 92cd859c-7667-42de-a02f-6f8260b325ab of volume ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca2b143-4708-4c66-948f-9c99bf99f441]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-02e719c1-72f1-4632-a062-b61e885b78d3 tempest-VolumeDependencyTests-2051825396 None] Create snapshot completed successfully Apr 21 20:59:55 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 Apr 21 20:59:55 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:55 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:55 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab 1G Apr 21 20:59:55 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab 1G" returned: 0 in 0.526s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab Apr 21 20:59:56 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (b492de7d-7264-4c13-8415-c1dd71802e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ff174b-499f-4a80-9023-b551c804970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ff174b-499f-4a80-9023-b551c804970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-483101256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d19691f-b705-42e8-a3ca-364d70cf9284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31f5dec3ddf4f09817cf69619b6762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9288340e-0942-4a4c-9786-0785e00c2fc8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:56Z,use_quota=True,user_id='99fe9151817b4ed4ae7bad9b759c8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d9b598-15b0-420c-8773-cb04f9d04005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d9b598-15b0-420c-8773-cb04f9d04005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94103c3c-2013-4006-b2e7-4b43cd0b3ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94103c3c-2013-4006-b2e7-4b43cd0b3ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d19691f-b705-42e8-a3ca-364d70cf9284', 'volume_name': 'volume-2d19691f-b705-42e8-a3ca-364d70cf9284', 'volume_size': 1, 'snapshot_id': '9288340e-0942-4a4c-9786-0785e00c2fc8'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388ad95c-5676-4286-a2dd-4d1d0fe29adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388ad95c-5676-4286-a2dd-4d1d0fe29adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc16632-7e13-47b7-a6f5-7b75a5c0d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Volume 2d19691f-b705-42e8-a3ca-364d70cf9284: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d19691f-b705-42e8-a3ca-364d70cf9284', 'volume_size': 1, 'snapshot_id': '9288340e-0942-4a4c-9786-0785e00c2fc8'} Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:56 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:56 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab is being set with open permissions: ugo+rw Apr 21 20:59:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab Apr 21 20:59:56 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab" returned: 0 in 0.446s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info Apr 21 20:59:57 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info" returned: 0 in 0.468s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info is being set with open permissions: ugo+rw Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info Apr 21 20:59:57 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.info" returned: 0 in 0.456s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.931s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.293s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-729993019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7f1921-0012-481a-8d71-81f945a17b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cfdbcfa744cdfae2c22112aa221e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:55Z,use_quota=True,user_id='4ca855a944e44b8e98c63cb82bfa2782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Creating volume ca7f1921-0012-481a-8d71-81f945a17b5f {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:58 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f 2147483648 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f 2147483648 Apr 21 20:59:58 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6eb40a6f-ec87-425e-965f-b12bff5d55e4 tempest-CinderUnicodeTest-1939934152 None] Create snapshot completed successfully Apr 21 20:59:58 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f 2147483648" returned: 0 in 0.492s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f Apr 21 20:59:58 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f" returned: 0 in 0.402s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.433s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-9288340e-0942-4a4c-9786-0785e00c2fc8-2d19691f-b705-42e8-a3ca-364d70cf9284" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7278f378-e405-4333-9db9-8aa420e7b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7f1921-0012-481a-8d71-81f945a17b5f', 'volume_size': 2}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58e98ed-5b70-4cfb-ad37-03d6072ec403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-9288340e-0942-4a4c-9786-0785e00c2fc8-2d19691f-b705-42e8-a3ca-364d70cf9284" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Creating volume 2d19691f-b705-42e8-a3ca-364d70cf9284 from snapshot 9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-2d19691f-b705-42e8-a3ca-364d70cf9284" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Volume volume-ca7f1921-0012-481a-8d71-81f945a17b5f (ca7f1921-0012-481a-8d71-81f945a17b5f): created successfully Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58e98ed-5b70-4cfb-ad37-03d6072ec403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Flow 'volume_create_manager' (536ca5ab-bfd8-4c7c-bf2b-fe6698ce8a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-2d19691f-b705-42e8-a3ca-364d70cf9284" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] snapshot: 9288340e-0942-4a4c-9786-0785e00c2fc8, volume: 2d19691f-b705-42e8-a3ca-364d70cf9284, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:59:58 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ba30b863-5547-4030-8c63-c777f1dc9b46 tempest-VolumesCloneNegativeTest-200179082 None] Created volume successfully. Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdcb020-2bde-4af1-94e0-5e3b933fec87]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 Apr 21 20:59:59 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-92cd859c-7667-42de-a02f-6f8260b325ab-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-92cd859c-7667-42de-a02f-6f8260b325ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-quobyte-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-quobyte-92cd859c-7667-42de-a02f-6f8260b325ab" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-92cd859c-7667-42de-a02f-6f8260b325ab" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Deleting offline snapshot 92cd859c-7667-42de-a02f-6f8260b325ab of volume ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] snapshot_file for this snap is: volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799a0c7-ae6a-4a84-b785-02183d85f678]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab Apr 21 20:59:59 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8" returned: 0 in 0.576s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925f4b0f-9f5a-48e1-829f-3f56256a589b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8781e2e-1d99-47a3-90a4-f63abb3760d7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 20:59:59 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab" returned: 0 in 0.541s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a6e3a-1165-41fc-ad96-6bd9b1e40e43]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 Apr 21 20:59:59 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Acquiring lock "cinder-ca7f1921-0012-481a-8d71-81f945a17b5f-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Lock "cinder-ca7f1921-0012-481a-8d71-81f945a17b5f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Acquiring lock "cinder-quobyte-ca7f1921-0012-481a-8d71-81f945a17b5f" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Lock "cinder-quobyte-ca7f1921-0012-481a-8d71-81f945a17b5f" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5228f6b-3492-40b7-9a32-85541310fc42]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:00 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 Apr 21 21:00:00 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:00 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab Apr 21 21:00:00 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:00 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f" returned: 0 in 0.616s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f Apr 21 21:00:00 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:01 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab" returned: 0 in 0.883s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:01 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab Apr 21 21:00:01 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ca7f1921-0012-481a-8d71-81f945a17b5f" returned: 0 in 1.694s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Lock "cinder-quobyte-ca7f1921-0012-481a-8d71-81f945a17b5f" released by "delete_volume" :: held 2.347s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Created reservations ['f25427cc-f4e8-47e8-aea1-8b8b38da411a', '4b2fe6bc-1bb9-4f85-a43f-7df44072fd80', '57ac24d8-66c7-4c41-89f9-fb13bddc5a07', '5a59b92e-1fa9-4001-a15d-3cd3e07c2e81'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:02 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813.92cd859c-7667-42de-a02f-6f8260b325ab" returned: 0 in 1.336s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-92cd859c-7667-42de-a02f-6f8260b325ab" released by "_delete_snapshot" :: held 3.347s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" released by "delete_snapshot" :: held 3.362s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284" returned: 0 in 2.412s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ba00a-1898-4fb3-96c0-2a2524020b6a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:02 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Created reservations ['cd7ee179-8918-4d8e-8a02-78448b8b1e3b', 'f89d4285-4ade-493b-af31-b3ddd8a52f7a', '88797a9a-a7c4-4f62-9511-156c55a71ab6', '574bb0be-3dbb-423c-85fe-59b1ed51ae82'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Delete snapshot completed successfully. Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-10397daa-5039-42e1-bd92-4a2815c17eea tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-92cd859c-7667-42de-a02f-6f8260b325ab-delete_snapshot" released by "delete_snapshot" :: held 3.475s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 21:00:02 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.446s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Deleted volume successfully. Apr 21 21:00:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b6cf28f9-93c7-412c-a436-0858a2a1a029 tempest-VolumesCloneNegativeTest-200179082 None] Lock "cinder-ca7f1921-0012-481a-8d71-81f945a17b5f-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:03 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.597s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:03 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Converted 1024.00 MB image at 424.25 MB/s Apr 21 21:00:03 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 is being set with open permissions: ugo+rw Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 Apr 21 21:00:03 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-ae7446f7-75d4-47e7-89f7-ba13ac6ea813-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-ae7446f7-75d4-47e7-89f7-ba13ac6ea813-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=159,cinder:UPDATE=281,cinder:DELETE=23,cinder:INSERT=58 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-quobyte-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[96acda9f-f45f-412d-8af7-094cfae19c73]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 Apr 21 21:00:03 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-2d19691f-b705-42e8-a3ca-364d70cf9284" released by "_copy_volume_from_snapshot" :: held 4.652s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-9288340e-0942-4a4c-9786-0785e00c2fc8-2d19691f-b705-42e8-a3ca-364d70cf9284" released by "_create_volume_from_snapshot" :: held 4.680s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.699s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc16632-7e13-47b7-a6f5-7b75a5c0d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d19691f-b705-42e8-a3ca-364d70cf9284', 'volume_size': 1, 'snapshot_id': '9288340e-0942-4a4c-9786-0785e00c2fc8'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa08c9aa-d132-4418-af8f-ce0718f0c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Volume volume-2d19691f-b705-42e8-a3ca-364d70cf9284 (2d19691f-b705-42e8-a3ca-364d70cf9284): created successfully Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa08c9aa-d132-4418-af8f-ce0718f0c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (b492de7d-7264-4c13-8415-c1dd71802e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c10defc6-aece-4001-a49a-908c4ba3d1f4 tempest-VolumeDependencyTests-2051825396 None] Created volume successfully. Apr 21 21:00:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-9288340e-0942-4a4c-9786-0785e00c2fc8-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-9288340e-0942-4a4c-9786-0785e00c2fc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-925f4b0f-9f5a-48e1-829f-3f56256a589b" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-925f4b0f-9f5a-48e1-829f-3f56256a589b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-9288340e-0942-4a4c-9786-0785e00c2fc8" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" returned: 0 in 0.549s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-9288340e-0942-4a4c-9786-0785e00c2fc8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Deleting offline snapshot 9288340e-0942-4a4c-9786-0785e00c2fc8 of volume 925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:04 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813 Apr 21 21:00:04 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] snapshot_file for this snap is: volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0c88d-03df-4df0-84a0-5bd1d02e9368]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 Apr 21 21:00:04 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" returned: 0 in 0.512s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-ae7446f7-75d4-47e7-89f7-ba13ac6ea813" released by "delete_volume" :: held 1.102s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:04 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Created reservations ['d8b83c66-baf4-4672-b710-8f83c4e55825', 'd1e9d6b4-33f9-4c99-be77-fcdff604ea7e', 'cec079b4-415c-4f5f-99ba-028bd9ba2cc9', '0b2bf809-50e3-49bf-b8e5-30bc9d939654'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8" returned: 0 in 0.552s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925f4b0f-9f5a-48e1-829f-3f56256a589b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee25757d-f3af-43d7-b973-6d6f1be66177]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 21:00:04 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:04 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.407s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Deleted volume successfully. Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-63455f9e-3e54-4f15-961e-f7506b814ec6 tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-ae7446f7-75d4-47e7-89f7-ba13ac6ea813-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:05 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.524s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 Apr 21 21:00:05 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Flow 'volume_create_manager' (874adf76-e864-45c1-a5d9-87a5b788802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae85a39-6f34-4b10-8689-7d1a882e2257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae85a39-6f34-4b10-8689-7d1a882e2257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2032258107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9fc4f5-0342-438a-996b-90a067e7385d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20cac688d924bea8d75381e1dbfb862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:05Z,use_quota=True,user_id='87f8f404d3d64092bb0eeb86901d8813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f8ba6e-0767-41be-b4fe-6b5d02f0e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f8ba6e-0767-41be-b4fe-6b5d02f0e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874fd18d-6ee6-4c76-904a-421951e4d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.image.glance [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Creating Keystone auth plugin from conf {{(pid=82005) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-c6611b4a-06a4-4653-b35f-ceead95df06c-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-c6611b4a-06a4-4653-b35f-ceead95df06c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "cinder-quobyte-c6611b4a-06a4-4653-b35f-ceead95df06c" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:05 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8" returned: 0 in 0.475s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-c6611b4a-06a4-4653-b35f-ceead95df06c" acquired by "delete_volume" :: waited 0.018s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:05 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8 Apr 21 21:00:05 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cffa1d2-79cc-4f68-8291-69c224e80be6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c Apr 21 21:00:05 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874fd18d-6ee6-4c76-904a-421951e4d37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc9fc4f5-0342-438a-996b-90a067e7385d', 'volume_name': 'volume-cc9fc4f5-0342-438a-996b-90a067e7385d', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b14e31-5b5b-4436-8e2a-c93972a45df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b14e31-5b5b-4436-8e2a-c93972a45df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2cbd32-2e60-4dce-a8f8-63f9a984c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:05 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Volume cc9fc4f5-0342-438a-996b-90a067e7385d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc9fc4f5-0342-438a-996b-90a067e7385d', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Trying to clone cc9fc4f5-0342-438a-996b-90a067e7385d from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]). {{(pid=82005) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 21:00:05 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Image download 20.69 MB at 20.69 MB/s Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8aaed9-9b5c-4c5f-9cb2-09d13217bb20]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD Apr 21 21:00:06 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b.9288340e-0942-4a4c-9786-0785e00c2fc8" returned: 0 in 0.478s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-9288340e-0942-4a4c-9786-0785e00c2fc8" released by "_delete_snapshot" :: held 2.090s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-925f4b0f-9f5a-48e1-829f-3f56256a589b" released by "delete_snapshot" :: held 2.112s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Created reservations ['a6514a80-9e1f-47f0-8fd5-f36a3bc85004', '2fd04bee-3b01-4566-919e-06d2de09a366', 'd4537dd5-1a55-47ab-b242-dc6678027179', 'c0d370b2-3177-4b38-a7c0-300f8d7b1da6'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Delete snapshot completed successfully. Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5ba7446f-a1a1-446f-ba12-0dd0fb10ef2d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-9288340e-0942-4a4c-9786-0785e00c2fc8-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:06 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c" returned: 0 in 0.571s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c Apr 21 21:00:06 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f is fetched for user 87f8f404d3d64092bb0eeb86901d8813. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f91f8e-4172-45ca-85e4-19c818a26742]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD Apr 21 21:00:06 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c6611b4a-06a4-4653-b35f-ceead95df06c" returned: 0 in 0.424s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-quobyte-c6611b4a-06a4-4653-b35f-ceead95df06c" released by "delete_volume" :: held 1.021s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Created reservations ['1f18a50b-64aa-4d05-a68e-7205e992a3a1', '2e8f8864-35da-4af3-9948-38b4c68a675f', '297a315b-0dd2-41c5-8cd2-c1371f99c435', 'dca5b896-6a59-4623-a835-11c18d708f75'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:06 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2032258107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9fc4f5-0342-438a-996b-90a067e7385d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20cac688d924bea8d75381e1dbfb862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:05Z,use_quota=True,user_id='87f8f404d3d64092bb0eeb86901d8813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Creating volume cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:07 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 1073741824 Apr 21 21:00:07 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-925f4b0f-9f5a-48e1-829f-3f56256a589b-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-925f4b0f-9f5a-48e1-829f-3f56256a589b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:07 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-925f4b0f-9f5a-48e1-829f-3f56256a589b" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.438s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-925f4b0f-9f5a-48e1-829f-3f56256a589b" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Deleted volume successfully. Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9940f1-48a7-4d42-94ed-bb3c388fab26]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-96321a08-2ca3-4244-b257-af6c1a0c181a tempest-CinderUnicodeTest-1939934152 None] Lock "cinder-c6611b4a-06a4-4653-b35f-ceead95df06c-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:07 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 21:00:07 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 1073741824" returned: 0 in 0.543s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:07 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:07 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.495s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b Apr 21 21:00:07 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Attempting download of 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume cc9fc4f5-0342-438a-996b-90a067e7385d. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181a007-f07a-4cf6-803a-878b3b7272c4]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-925f4b0f-9f5a-48e1-829f-3f56256a589b" returned: 0 in 0.438s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-925f4b0f-9f5a-48e1-829f-3f56256a589b" released by "delete_volume" :: held 0.969s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Created reservations ['0265db01-e5f9-4739-88c0-2324f7e93f01', 'b364120a-84a0-4cd9-a174-98df68fa52d7', '847759f1-e285-40d2-9130-2c5ca7d47dbe', '1ae9e28b-a0b8-4b08-ba68-99ceef7f44aa'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:08 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks Apr 21 21:00:08 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:08 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks" returned: 0 in 0.548s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Deleted volume successfully. Apr 21 21:00:08 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks Apr 21 21:00:08 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c87c8b38-0acc-47df-a672-ffdc927019f3 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-925f4b0f-9f5a-48e1-829f-3f56256a589b-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:09 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks" returned: 1 in 0.482s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_wrs_2lks' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd76260-e691-4a53-98c4-8cc366bbcf15]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:09 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD Apr 21 21:00:09 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (06663a5d-b622-4cf4-a3c1-ab58ac6835c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29534bf-3b1a-4725-ad2b-529342b788e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29534bf-3b1a-4725-ad2b-529342b788e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1441920016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fd6194-884e-40b9-a6f1-0e382fd75535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31f5dec3ddf4f09817cf69619b6762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:10Z,use_quota=True,user_id='99fe9151817b4ed4ae7bad9b759c8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b290b834-dc46-4d9c-9209-763b5b3a4f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b290b834-dc46-4d9c-9209-763b5b3a4f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d226d742-4e2e-4987-9858-360140eff71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d226d742-4e2e-4987-9858-360140eff71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fd6194-884e-40b9-a6f1-0e382fd75535', 'volume_name': 'volume-36fd6194-884e-40b9-a6f1-0e382fd75535', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70fe7d0-0634-48d6-9eee-ff176d0eb27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70fe7d0-0634-48d6-9eee-ff176d0eb27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645024cc-4c55-414b-a85a-51b23368a945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Volume 36fd6194-884e-40b9-a6f1-0e382fd75535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fd6194-884e-40b9-a6f1-0e382fd75535', 'volume_size': 1} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1441920016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fd6194-884e-40b9-a6f1-0e382fd75535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31f5dec3ddf4f09817cf69619b6762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:10Z,use_quota=True,user_id='99fe9151817b4ed4ae7bad9b759c8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Creating volume 36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:09 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:09 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 1073741824 Apr 21 21:00:09 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:09 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f was qcow2, converting to raw {{(pid=82005) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 21:00:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:09 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:09 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 1073741824" returned: 0 in 0.549s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:10 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 0 in 1.046s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25e6fbc7-91cc-4500-9ce6-11f79ac6da2f_7tk9zruqdevstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:10 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Converted 112.00 MB image at 106.92 MB/s Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 1G Apr 21 21:00:10 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.554s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645024cc-4c55-414b-a85a-51b23368a945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fd6194-884e-40b9-a6f1-0e382fd75535', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35154af4-cc5c-4941-b977-156d9a45ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Volume volume-36fd6194-884e-40b9-a6f1-0e382fd75535 (36fd6194-884e-40b9-a6f1-0e382fd75535): created successfully Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35154af4-cc5c-4941-b977-156d9a45ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (06663a5d-b622-4cf4-a3c1-ab58ac6835c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2c920826-1728-411a-8eab-944e41d8104a tempest-VolumeDependencyTests-2051825396 None] Created volume successfully. Apr 21 21:00:11 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 1G" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0190deff-04a5-47d2-ab89-f043f110985c]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:11 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 0 in 0.521s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:11 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (c433e886-8557-4568-a8e1-cab9852f8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87ec0e7-aa2d-478b-b8c5-52d545759c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87ec0e7-aa2d-478b-b8c5-52d545759c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1083047939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421954ab-7891-4437-8fcb-d06b8d324053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31f5dec3ddf4f09817cf69619b6762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=36fd6194-884e-40b9-a6f1-0e382fd75535,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:12Z,use_quota=True,user_id='99fe9151817b4ed4ae7bad9b759c8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d022b9d2-0ab6-47c0-983b-c71ac02a7134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d022b9d2-0ab6-47c0-983b-c71ac02a7134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486acbb2-6e04-47c1-bc74-8e85ddf63603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486acbb2-6e04-47c1-bc74-8e85ddf63603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '421954ab-7891-4437-8fcb-d06b8d324053', 'volume_name': 'volume-421954ab-7891-4437-8fcb-d06b8d324053', 'volume_size': 1, 'source_volid': '36fd6194-884e-40b9-a6f1-0e382fd75535', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c564afd-79d6-4b5a-b897-edfdf699ccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c564afd-79d6-4b5a-b897-edfdf699ccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845b00a0-4b7b-4df0-a52c-a099731e1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Volume 421954ab-7891-4437-8fcb-d06b8d324053: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-421954ab-7891-4437-8fcb-d06b8d324053', 'volume_size': 1, 'source_volid': '36fd6194-884e-40b9-a6f1-0e382fd75535', 'source_volstatus': 'available'} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:12 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Cloning volume 36fd6194-884e-40b9-a6f1-0e382fd75535 to volume 421954ab-7891-4437-8fcb-d06b8d324053 Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Creating offline snapshot 9800e421-726e-4bf7-a7db-05588a0fae67 of volume 36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5384c319-0b15-4782-8f44-e3feb14d5c22]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:12 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:12 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 1 in 0.478s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Downloaded image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f ((None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}])) to volume cc9fc4f5-0342-438a-996b-90a067e7385d successfully. {{(pid=82005) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Temporary image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f for user 87f8f404d3d64092bb0eeb86901d8813 is deleted. {{(pid=82005) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.volume_utils [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Marking volume cc9fc4f5-0342-438a-996b-90a067e7385d as bootable. {{(pid=82005) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Copying metadata from image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f to cc9fc4f5-0342-438a-996b-90a067e7385d. {{(pid=82005) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Creating volume glance metadata for volume cc9fc4f5-0342-438a-996b-90a067e7385d backed by image 25e6fbc7-91cc-4500-9ce6-11f79ac6da2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82005) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2cbd32-2e60-4dce-a8f8-63f9a984c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9fc4f5-0342-438a-996b-90a067e7385d', 'volume_size': 1, 'image_id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f01cc3daf1ba4631a0c9a327ff557a11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25e6fbc7-91cc-4500-9ce6-11f79ac6da2f', 'created_at': datetime.datetime(2026, 4, 21, 18, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25e6fbc7-91cc-4500-9ce6-11f79ac6da2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa36d7e-bfd9-4a40-9c12-6fa1b0aa1c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:12 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Volume volume-cc9fc4f5-0342-438a-996b-90a067e7385d (cc9fc4f5-0342-438a-996b-90a067e7385d): created successfully Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa36d7e-bfd9-4a40-9c12-6fa1b0aa1c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Flow 'volume_create_manager' (874adf76-e864-45c1-a5d9-87a5b788802e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:12 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-930ce7d7-cd85-4fec-8b77-ee76db4c91ec tempest-VolumesExtendTest-2133909710 None] Created volume successfully. Apr 21 21:00:12 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.579s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:12 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 1G Apr 21 21:00:12 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:13 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 1G" returned: 0 in 0.556s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fd6194-884e-40b9-a6f1-0e382fd75535 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fd6194-884e-40b9-a6f1-0e382fd75535 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 Apr 21 21:00:13 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fd6194-884e-40b9-a6f1-0e382fd75535 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67" returned: 0 in 0.495s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 is being set with open permissions: ugo+rw Apr 21 21:00:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 Apr 21 21:00:13 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67" returned: 0 in 0.470s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info Apr 21 21:00:14 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info" returned: 0 in 0.414s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info is being set with open permissions: ugo+rw Apr 21 21:00:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info Apr 21 21:00:14 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.info" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-421954ab-7891-4437-8fcb-d06b8d324053" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-421954ab-7891-4437-8fcb-d06b8d324053" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] snapshot: 9800e421-726e-4bf7-a7db-05588a0fae67, volume: 421954ab-7891-4437-8fcb-d06b8d324053, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b818e42-8e25-4367-8858-a105d62ad8d8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 Apr 21 21:00:15 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67" returned: 0 in 0.508s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36fd6194-884e-40b9-a6f1-0e382fd75535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[59db4bfc-1bf7-4ef3-b8d3-721c418cd64c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:15 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:16 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.535s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:16 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 Apr 21 21:00:16 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053" returned: 0 in 1.999s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:18 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7387291b-1b1f-4da1-8826-578af83b93ec]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:18 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:18 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.619s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:18 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:18 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Converted 1024.00 MB image at 511.86 MB/s Apr 21 21:00:18 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 is being set with open permissions: ugo+rw Apr 21 21:00:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:18 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 Apr 21 21:00:18 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:19 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053" returned: 0 in 0.425s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-421954ab-7891-4437-8fcb-d06b8d324053" released by "_copy_volume_from_snapshot" :: held 4.139s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-9800e421-726e-4bf7-a7db-05588a0fae67" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-9800e421-726e-4bf7-a7db-05588a0fae67" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Deleting offline snapshot 9800e421-726e-4bf7-a7db-05588a0fae67 of volume 36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] snapshot_file for this snap is: volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c03d6-0727-49f6-9a2d-66fe8427510d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:19 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 Apr 21 21:00:19 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:19 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67" returned: 0 in 0.554s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36fd6194-884e-40b9-a6f1-0e382fd75535(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa526c6-2a47-43f4-a91a-f86cb375ff85]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:19 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:19 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:20 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.497s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:20 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 Apr 21 21:00:20 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:20 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67" returned: 0 in 0.498s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:20 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67 Apr 21 21:00:20 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:21 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535.9800e421-726e-4bf7-a7db-05588a0fae67" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-9800e421-726e-4bf7-a7db-05588a0fae67" released by "_delete_snapshot" :: held 2.048s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.261s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.445s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845b00a0-4b7b-4df0-a52c-a099731e1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421954ab-7891-4437-8fcb-d06b8d324053', 'volume_size': 1, 'source_volid': '36fd6194-884e-40b9-a6f1-0e382fd75535', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769a0227-080d-4ce9-8517-86ba01eef1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:21 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Volume volume-421954ab-7891-4437-8fcb-d06b8d324053 (421954ab-7891-4437-8fcb-d06b8d324053): created successfully Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769a0227-080d-4ce9-8517-86ba01eef1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Flow 'volume_create_manager' (c433e886-8557-4568-a8e1-cab9852f8908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e6f73-3a29-4e66-8067-ebfa4eb841cd]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:21 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f6a3578c-aa3e-4280-ac33-f5a5cf8d7c95 tempest-VolumeDependencyTests-2051825396 None] Created volume successfully. Apr 21 21:00:21 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:21 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-36fd6194-884e-40b9-a6f1-0e382fd75535-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-36fd6194-884e-40b9-a6f1-0e382fd75535-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-36fd6194-884e-40b9-a6f1-0e382fd75535" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-36fd6194-884e-40b9-a6f1-0e382fd75535" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a923936-9dcd-428f-a723-8e540946c4cc]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:21 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:21 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 0 in 0.628s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:22 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.603s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535 Apr 21 21:00:22 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 1 in 0.605s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 2G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d 2G" returned: 0 in 0.069s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.351s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:22 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-029ed750-8bc1-40d8-8746-6d60573f047d tempest-VolumesExtendTest-2133909710 None] Extend volume completed successfully. Apr 21 21:00:22 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-36fd6194-884e-40b9-a6f1-0e382fd75535" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-36fd6194-884e-40b9-a6f1-0e382fd75535" released by "delete_volume" :: held 1.159s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Created reservations ['50f8be52-ceb3-4649-9e16-387fe09d6a62', '4e74c098-7193-4b07-a1f5-81eae95d1039', '7a688c6b-39a7-4286-8d7a-518f1d4a6bd2', 'ec84ea23-5539-41f2-a2e6-adfc05cf01d8'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:22 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:23 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.435s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:23 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Deleted volume successfully. Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94089376-0f94-4200-9dc1-975fe78dd13a tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-36fd6194-884e-40b9-a6f1-0e382fd75535-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-cc9fc4f5-0342-438a-996b-90a067e7385d-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-421954ab-7891-4437-8fcb-d06b8d324053-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-cc9fc4f5-0342-438a-996b-90a067e7385d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-421954ab-7891-4437-8fcb-d06b8d324053-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-421954ab-7891-4437-8fcb-d06b8d324053" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-quobyte-cc9fc4f5-0342-438a-996b-90a067e7385d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-421954ab-7891-4437-8fcb-d06b8d324053" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-cc9fc4f5-0342-438a-996b-90a067e7385d" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c0e243-89b1-45b0-b306-5fbe31a62817]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a4b3e-5b1f-45e0-b74a-0ddfbfffe157]: (4, 'raw') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:23 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 Apr 21 21:00:23 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:23 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:23 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053" returned: 0 in 0.499s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053 Apr 21 21:00:24 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:24 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-421954ab-7891-4437-8fcb-d06b8d324053" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-421954ab-7891-4437-8fcb-d06b8d324053" released by "delete_volume" :: held 1.015s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:24 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 1 in 0.519s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d' failed. Not Retrying. {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Created reservations ['86044b81-ffb1-44dd-9171-bd3eb279feb3', 'ba326087-40b4-41c8-aff3-ce53fca22c6f', '8a56e31c-adb7-4dda-b7c8-5f55de38f4c4', '05657504-8fde-4876-aea7-f0396f3f108c'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:24 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d Apr 21 21:00:24 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:25 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:25 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Flow 'volume_create_manager' (f7cf5987-d5c0-486b-9975-e8808254912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6de702c-46f4-4ca2-8540-dcec583dfee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6de702c-46f4-4ca2-8540-dcec583dfee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1749532911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b90b1fb-0ae2-479d-afe5-2103ba46153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc8793ed8b944e4bea8357b470f919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:25Z,use_quota=True,user_id='687543247d7246d69edfa049dc404f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143f5068-b507-47f1-9b70-0e0a58ced955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143f5068-b507-47f1-9b70-0e0a58ced955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee34ac0a-a5e3-405d-9a39-ef2a25bcb1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee34ac0a-a5e3-405d-9a39-ef2a25bcb1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b90b1fb-0ae2-479d-afe5-2103ba46153f', 'volume_name': 'volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0af348-662e-4ecf-bca7-da2d7017b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0af348-662e-4ecf-bca7-da2d7017b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e220e92-a2d6-4e79-845c-372b3a879557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:25 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Volume 5b90b1fb-0ae2-479d-afe5-2103ba46153f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f', 'volume_size': 1} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1749532911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b90b1fb-0ae2-479d-afe5-2103ba46153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc8793ed8b944e4bea8357b470f919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:25Z,use_quota=True,user_id='687543247d7246d69edfa049dc404f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Creating volume 5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:25 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:25 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f 1073741824 Apr 21 21:00:25 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-cc9fc4f5-0342-438a-996b-90a067e7385d" returned: 0 in 0.436s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-cc9fc4f5-0342-438a-996b-90a067e7385d" released by "delete_volume" :: held 1.489s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:25 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.412s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Created reservations ['5d9359ab-aef5-4530-81ef-5ed257100a0e', '4c9cf251-700f-401d-b018-1ddcb8d40081', '7c87e4ac-69e2-4dfa-ae3b-ee7f4cb1efb0', '8e830675-fa76-46b9-a2ca-d67b3a456ff1'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Deleted volume successfully. Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c03bfc6-2f73-4eaf-98e9-18a6835d4760 tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-421954ab-7891-4437-8fcb-d06b8d324053-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:25 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:25 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f 1073741824" returned: 0 in 0.480s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:25 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:25 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.427s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Deleted volume successfully. Apr 21 21:00:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4566cd44-f021-4282-a850-96612b03cbd8 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-cc9fc4f5-0342-438a-996b-90a067e7385d-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-2d19691f-b705-42e8-a3ca-364d70cf9284-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-2d19691f-b705-42e8-a3ca-364d70cf9284-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:26 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e220e92-a2d6-4e79-845c-372b3a879557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fadc62-b302-47d8-8363-cbdd2ba96086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Volume volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f (5b90b1fb-0ae2-479d-afe5-2103ba46153f): created successfully Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fadc62-b302-47d8-8363-cbdd2ba96086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Flow 'volume_create_manager' (f7cf5987-d5c0-486b-9975-e8808254912d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "cinder-quobyte-2d19691f-b705-42e8-a3ca-364d70cf9284" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Flow 'volume_create_manager' (f2391776-e99f-47d7-ba3b-2a5a01275b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851a4ea-8782-479f-b5e7-421e32c34b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-caac963c-a212-488e-a82e-591f096d1bfb tempest-SnapshotDependencyTests-1709512385 None] Created volume successfully. Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-2d19691f-b705-42e8-a3ca-364d70cf9284" acquired by "delete_volume" :: waited 0.037s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851a4ea-8782-479f-b5e7-421e32c34b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-931600463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e738886-7e9c-4466-aa57-cf9d1e72071e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20cac688d924bea8d75381e1dbfb862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:26Z,use_quota=True,user_id='87f8f404d3d64092bb0eeb86901d8813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b4691f-c777-4a5e-a7ff-6b9431ed617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b4691f-c777-4a5e-a7ff-6b9431ed617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6114c810-6472-48c3-93aa-f427ceedee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6114c810-6472-48c3-93aa-f427ceedee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e738886-7e9c-4466-aa57-cf9d1e72071e', 'volume_name': 'volume-9e738886-7e9c-4466-aa57-cf9d1e72071e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609f6c00-2125-40ab-b8f5-991049d83aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609f6c00-2125-40ab-b8f5-991049d83aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02d1838-8556-4e79-97e0-cf2a0f314dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Volume 9e738886-7e9c-4466-aa57-cf9d1e72071e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e738886-7e9c-4466-aa57-cf9d1e72071e', 'volume_size': 1} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-931600463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e738886-7e9c-4466-aa57-cf9d1e72071e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20cac688d924bea8d75381e1dbfb862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:26Z,use_quota=True,user_id='87f8f404d3d64092bb0eeb86901d8813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Creating volume 9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:26 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[16148958-71be-4e3a-98d3-3f4751fa2e17]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e 1073741824 Apr 21 21:00:26 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 Apr 21 21:00:26 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e 1073741824" returned: 0 in 0.456s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:26 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284 Apr 21 21:00:26 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e Apr 21 21:00:26 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:27 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e" returned: 0 in 0.388s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02d1838-8556-4e79-97e0-cf2a0f314dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e738886-7e9c-4466-aa57-cf9d1e72071e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f09156d-208d-4ecb-84b3-f5fcd0f5d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:27 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Volume volume-9e738886-7e9c-4466-aa57-cf9d1e72071e (9e738886-7e9c-4466-aa57-cf9d1e72071e): created successfully Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f09156d-208d-4ecb-84b3-f5fcd0f5d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Flow 'volume_create_manager' (f2391776-e99f-47d7-ba3b-2a5a01275b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2d19691f-b705-42e8-a3ca-364d70cf9284" returned: 0 in 0.430s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-41d21d10-8c2d-4969-a9b1-10714f523595 tempest-VolumesExtendTest-2133909710 None] Created volume successfully. Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-quobyte-2d19691f-b705-42e8-a3ca-364d70cf9284" released by "delete_volume" :: held 0.962s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Created reservations ['c461413f-2b0f-4fac-8411-6badce93f387', '7a2a1daf-7ed6-462e-93c5-3d21fa474392', 'cb53cd42-8f34-4cf2-ab5f-f031b119bb87', '737bab48-110f-41d8-93cd-f9c59322d7e6'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:27 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:27 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Creating offline snapshot 3dcace61-736c-465b-beb2-7a97151670ba of volume 9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b960e1c1-7123-4bec-93c0-74ca8aae5dce]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:27 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e Apr 21 21:00:27 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:27 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.423s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Deleted volume successfully. Apr 21 21:00:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-9e8893a8-5c17-4114-b198-285b4070148d tempest-VolumeDependencyTests-2051825396 None] Lock "cinder-2d19691f-b705-42e8-a3ca-364d70cf9284-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:28 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba 1G Apr 21 21:00:28 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:28 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba 1G" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e738886-7e9c-4466-aa57-cf9d1e72071e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e738886-7e9c-4466-aa57-cf9d1e72071e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba Apr 21 21:00:28 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:28 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e738886-7e9c-4466-aa57-cf9d1e72071e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba" returned: 0 in 0.461s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:28 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba is being set with open permissions: ugo+rw Apr 21 21:00:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba Apr 21 21:00:28 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:29 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:29 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info Apr 21 21:00:29 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:29 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info" returned: 0 in 0.403s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:29 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info is being set with open permissions: ugo+rw Apr 21 21:00:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:29 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info Apr 21 21:00:29 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:30 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.info" returned: 0 in 0.386s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.648s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Creating offline snapshot f216df67-538b-49ff-bbbf-c85ea413ac3c of volume 5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:30 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c64ae027-c307-4e7c-9bc0-340c6de0629d tempest-VolumesExtendTest-2133909710 None] Create snapshot completed successfully Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff41825-e8d8-4880-ab99-a0880a69a96f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:30 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:30 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:30 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.476s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:30 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c 1G Apr 21 21:00:30 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c 1G" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:31 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c Apr 21 21:00:31 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c" returned: 0 in 0.396s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c is being set with open permissions: ugo+rw Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:31 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c Apr 21 21:00:31 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c" returned: 0 in 0.400s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=161,cinder:INSERT=48,cinder:UPDATE=193,cinder:DELETE=19 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:32 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info Apr 21 21:00:32 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:32 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info" returned: 0 in 0.395s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:32 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info is being set with open permissions: ugo+rw Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:32 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info Apr 21 21:00:32 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:32 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.info" returned: 0 in 0.386s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.050s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e73fc9-bd78-498c-9260-ba1ed53437f2]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-9654c132-f594-4243-aec1-60bd0cd91d9b tempest-SnapshotDependencyTests-1709512385 None] Create snapshot completed successfully Apr 21 21:00:32 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e Apr 21 21:00:32 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:33 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e" returned: 0 in 0.438s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba 2G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba 2G" returned: 0 in 0.051s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.506s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:33 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7411131f-5c41-4536-89a5-6cc9d7e4599b tempest-VolumesExtendTest-2133909710 None] Extend volume completed successfully. Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-3dcace61-736c-465b-beb2-7a97151670ba-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-3dcace61-736c-465b-beb2-7a97151670ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-quobyte-9e738886-7e9c-4466-aa57-cf9d1e72071e" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-9e738886-7e9c-4466-aa57-cf9d1e72071e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-quobyte-3dcace61-736c-465b-beb2-7a97151670ba" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-3dcace61-736c-465b-beb2-7a97151670ba" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Deleting offline snapshot 3dcace61-736c-465b-beb2-7a97151670ba of volume 9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] snapshot_file for this snap is: volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb865a-11be-4ea3-bc4e-1a4d372eae86]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:34 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba Apr 21 21:00:34 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Flow 'volume_create_manager' (315dc473-0029-4703-a154-698ae62be31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e2aeee-3d55-4930-8c31-2e148cf329a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e2aeee-3d55-4930-8c31-2e148cf329a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484c34b5-ce0e-46d1-b708-54e3bcbaf43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc8793ed8b944e4bea8357b470f919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f216df67-538b-49ff-bbbf-c85ea413ac3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:34Z,use_quota=True,user_id='687543247d7246d69edfa049dc404f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2103ea38-e61a-45a3-b26d-f16d1da6c885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2103ea38-e61a-45a3-b26d-f16d1da6c885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb6f490-1825-40e8-81d1-f6295175854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb6f490-1825-40e8-81d1-f6295175854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '484c34b5-ce0e-46d1-b708-54e3bcbaf43e', 'volume_name': 'volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e', 'volume_size': 1, 'snapshot_id': 'f216df67-538b-49ff-bbbf-c85ea413ac3c'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62e047d-4b20-4aed-b45d-62d40ac5ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62e047d-4b20-4aed-b45d-62d40ac5ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90c4cd6-0b79-4d2c-a526-ab53445ebc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:34 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Volume 484c34b5-ce0e-46d1-b708-54e3bcbaf43e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e', 'volume_size': 1, 'snapshot_id': 'f216df67-538b-49ff-bbbf-c85ea413ac3c'} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-quobyte-f216df67-538b-49ff-bbbf-c85ea413ac3c-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-f216df67-538b-49ff-bbbf-c85ea413ac3c-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Creating volume 484c34b5-ce0e-46d1-b708-54e3bcbaf43e from snapshot f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-quobyte-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] snapshot: f216df67-538b-49ff-bbbf-c85ea413ac3c, volume: 484c34b5-ce0e-46d1-b708-54e3bcbaf43e, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbf0b1-a369-4542-9819-9952cc0112df]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c Apr 21 21:00:34 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e738886-7e9c-4466-aa57-cf9d1e72071e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f67f27-8d21-4aaf-9b4a-b528f8df39df]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e Apr 21 21:00:34 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff2b279-a0e4-4eda-a231-1d343b6f96d5]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:34 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba Apr 21 21:00:35 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.468s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e Apr 21 21:00:35 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba Apr 21 21:00:35 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e.3dcace61-736c-465b-beb2-7a97151670ba" returned: 0 in 0.763s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-3dcace61-736c-465b-beb2-7a97151670ba" released by "_delete_snapshot" :: held 2.234s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-9e738886-7e9c-4466-aa57-cf9d1e72071e" released by "delete_snapshot" :: held 2.250s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Created reservations ['a3a64cc3-b778-43be-adf7-5688f43a2f1a', '4c457809-6a78-46f7-952e-0fee39ee3b31', 'd974ba3e-5e9e-4d26-b3f5-4c603614f0f7', 'e8637973-1903-43cd-a02f-c0d4c91735c5'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:36 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:36 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Delete snapshot completed successfully. Apr 21 21:00:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2eae419d-b024-4222-889a-43998fd780d1 tempest-VolumesExtendTest-2133909710 None] Lock "cinder-3dcace61-736c-465b-beb2-7a97151670ba-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:37 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" returned: 0 in 1.890s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff89ed02-43a2-442f-a12b-9c17906f57de]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:37 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-9e738886-7e9c-4466-aa57-cf9d1e72071e-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Lock "cinder-9e738886-7e9c-4466-aa57-cf9d1e72071e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Acquiring lock "cinder-quobyte-9e738886-7e9c-4466-aa57-cf9d1e72071e" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-9e738886-7e9c-4466-aa57-cf9d1e72071e" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:37 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.970s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d1205c-44ce-4c5a-a994-e031d70cbd9c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e Apr 21 21:00:37 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.627s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:37 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Converted 1024.00 MB image at 541.44 MB/s Apr 21 21:00:37 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e is being set with open permissions: ugo+rw Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e Apr 21 21:00:37 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e" returned: 0 in 0.451s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e Apr 21 21:00:37 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" returned: 0 in 0.380s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" released by "_copy_volume_from_snapshot" :: held 3.904s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-f216df67-538b-49ff-bbbf-c85ea413ac3c-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" released by "_create_volume_from_snapshot" :: held 3.920s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.929s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90c4cd6-0b79-4d2c-a526-ab53445ebc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e', 'volume_size': 1, 'snapshot_id': 'f216df67-538b-49ff-bbbf-c85ea413ac3c'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9cedbd-bfae-4f8c-8a15-e0f329cf09cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:38 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Volume volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e (484c34b5-ce0e-46d1-b708-54e3bcbaf43e): created successfully Apr 21 21:00:38 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9cedbd-bfae-4f8c-8a15-e0f329cf09cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Flow 'volume_create_manager' (315dc473-0029-4703-a154-698ae62be31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9e738886-7e9c-4466-aa57-cf9d1e72071e" returned: 0 in 0.387s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Lock "cinder-quobyte-9e738886-7e9c-4466-aa57-cf9d1e72071e" released by "delete_volume" :: held 0.875s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7b2069e5-f8da-4f11-920f-a0aeb25479e4 tempest-SnapshotDependencyTests-1709512385 None] Created volume successfully. Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Created reservations ['f4d9e706-0508-4240-abe4-693fafd80884', '9b57e282-c2b9-4c9b-9ffb-bfc0e6fe3563', 'c0ca81f5-c4bf-42b6-bb75-7cb983f80a9d', '95f5fb5a-87c9-47b6-b7ed-b11ea04b5c07'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:38 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:38 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-f216df67-538b-49ff-bbbf-c85ea413ac3c-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-f216df67-538b-49ff-bbbf-c85ea413ac3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-quobyte-5b90b1fb-0ae2-479d-afe5-2103ba46153f" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-5b90b1fb-0ae2-479d-afe5-2103ba46153f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-quobyte-f216df67-538b-49ff-bbbf-c85ea413ac3c" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-f216df67-538b-49ff-bbbf-c85ea413ac3c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Deleting offline snapshot f216df67-538b-49ff-bbbf-c85ea413ac3c of volume 5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] snapshot_file for this snap is: volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ae11be-fe7d-4f31-89fb-6e36137bafa8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:38 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c Apr 21 21:00:38 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.473s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:38 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Deleted volume successfully. Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-937d988b-9db9-440e-9d6a-eaa6cadd394d tempest-VolumesExtendTest-2133909710 None] Lock "cinder-9e738886-7e9c-4466-aa57-cf9d1e72071e-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:38 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c" returned: 0 in 0.537s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[4133b49f-5e68-418b-8f6c-b3495f3e540a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:39 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c Apr 21 21:00:39 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c Apr 21 21:00:39 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:40 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f.f216df67-538b-49ff-bbbf-c85ea413ac3c" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-f216df67-538b-49ff-bbbf-c85ea413ac3c" released by "_delete_snapshot" :: held 1.971s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-5b90b1fb-0ae2-479d-afe5-2103ba46153f" released by "delete_snapshot" :: held 1.983s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Created reservations ['a0712f05-a2d3-4fc2-8982-8b513f0ad5ee', 'eb261a55-1357-4d4a-ae62-6a03c250fa7a', 'cdabdee8-90e3-4dda-86b4-32a9a48a51c0', '5ce61b1d-dea9-4937-b645-d4a2c402916a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Delete snapshot completed successfully. Apr 21 21:00:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-11793351-5129-4e19-b2eb-35713b24d79c tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-f216df67-538b-49ff-bbbf-c85ea413ac3c-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-5b90b1fb-0ae2-479d-afe5-2103ba46153f-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-5b90b1fb-0ae2-479d-afe5-2103ba46153f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-quobyte-5b90b1fb-0ae2-479d-afe5-2103ba46153f" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-5b90b1fb-0ae2-479d-afe5-2103ba46153f" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c0179-264e-4f6c-a0da-3f156a717a00]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:41 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:41 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:42 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.528s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:42 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f Apr 21 21:00:42 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:42 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-5b90b1fb-0ae2-479d-afe5-2103ba46153f" returned: 0 in 0.438s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-5b90b1fb-0ae2-479d-afe5-2103ba46153f" released by "delete_volume" :: held 0.997s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Created reservations ['4bbc372e-a00c-446e-b046-3a0fa1981c1f', '81c28bdc-bfc8-49fb-8f2b-fcdb52d32485', '3f36aefe-e62a-4348-975c-99d1156df3af', '30605d62-2e48-4f20-8284-54c35e7b1c8c'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:42 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:42 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:43 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.427s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Deleted volume successfully. Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bc7c58f9-70c7-43ca-ade9-1e36b6d63aaf tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-5b90b1fb-0ae2-479d-afe5-2103ba46153f-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-484c34b5-ce0e-46d1-b708-54e3bcbaf43e-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-484c34b5-ce0e-46d1-b708-54e3bcbaf43e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "cinder-quobyte-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[01661183-b74e-4769-b23c-5118ca82cdcb]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:43 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e Apr 21 21:00:43 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:44 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" returned: 0 in 0.539s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:44 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e Apr 21 21:00:44 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:44 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" returned: 0 in 0.402s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-quobyte-484c34b5-ce0e-46d1-b708-54e3bcbaf43e" released by "delete_volume" :: held 0.964s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Created reservations ['28cb8762-eebc-42d7-9659-c63d8ad82d6e', '1995d680-4639-4fe8-8245-1b58dd203308', '26a9f95a-65c0-4788-9fa6-b46b7de76de4', 'afdd12b0-fbbe-4838-bde5-486de6b2d5f4'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:44 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:00:44 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:45 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.483s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:45 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Deleted volume successfully. Apr 21 21:00:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0f4afef9-f370-4bac-9749-2d02083f67c5 tempest-SnapshotDependencyTests-1709512385 None] Lock "cinder-484c34b5-ce0e-46d1-b708-54e3bcbaf43e-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:47 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (82ec8b4b-9b82-44bb-924c-6574f79c99bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:47 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0514c2aa-b84b-4d92-a50e-3684495f448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0514c2aa-b84b-4d92-a50e-3684495f448e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1136613481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d4c905-d819-48ba-9093-42340882b292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:48Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5639283a-8f3b-45e4-b84e-c2b6b8ae0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5639283a-8f3b-45e4-b84e-c2b6b8ae0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c23f6d-a2be-4949-9687-0c10366f46f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c23f6d-a2be-4949-9687-0c10366f46f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d4c905-d819-48ba-9093-42340882b292', 'volume_name': 'volume-76d4c905-d819-48ba-9093-42340882b292', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90376422-a152-4eef-9c19-d4a77cc2cafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90376422-a152-4eef-9c19-d4a77cc2cafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054ffd6f-c514-476a-8d8b-1042e7bec535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:48 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Volume 76d4c905-d819-48ba-9093-42340882b292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d4c905-d819-48ba-9093-42340882b292', 'volume_size': 1} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1136613481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d4c905-d819-48ba-9093-42340882b292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:48Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Creating volume 76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:48 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:48 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 1073741824 Apr 21 21:00:48 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:48 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 1073741824" returned: 0 in 0.554s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:48 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 Apr 21 21:00:48 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:49 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054ffd6f-c514-476a-8d8b-1042e7bec535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d4c905-d819-48ba-9093-42340882b292', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d663fe15-2c70-4444-965c-63da12f89796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:49 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Volume volume-76d4c905-d819-48ba-9093-42340882b292 (76d4c905-d819-48ba-9093-42340882b292): created successfully Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d663fe15-2c70-4444-965c-63da12f89796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:49 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (82ec8b4b-9b82-44bb-924c-6574f79c99bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:49 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-39f6b688-d189-4f1b-9ad6-9137b66ee1ab tempest-VolumesSnapshotTestJSON-673500952 None] Created volume successfully. Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Creating offline snapshot a928cff4-ae0f-42c6-9140-6cb9c6c00263 of volume 76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f3d18f-1a94-4635-94dc-b2760f823879]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:50 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 Apr 21 21:00:50 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:50 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292" returned: 0 in 0.516s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:50 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 1G Apr 21 21:00:50 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:51 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 1G" returned: 0 in 0.507s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d4c905-d819-48ba-9093-42340882b292 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:51 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d4c905-d819-48ba-9093-42340882b292 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 Apr 21 21:00:51 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:51 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d4c905-d819-48ba-9093-42340882b292 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:51 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 is being set with open permissions: ugo+rw Apr 21 21:00:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:51 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 Apr 21 21:00:51 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263" returned: 0 in 0.380s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:52 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info Apr 21 21:00:52 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info" returned: 0 in 0.384s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info is being set with open permissions: ugo+rw Apr 21 21:00:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:52 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info Apr 21 21:00:52 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.info" returned: 0 in 0.405s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:52 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6ddf0b1b-0ad8-44f7-a8d3-5edd3df5ffca tempest-VolumesSnapshotTestJSON-673500952 None] Create snapshot completed successfully Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-a928cff4-ae0f-42c6-9140-6cb9c6c00263-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-a928cff4-ae0f-42c6-9140-6cb9c6c00263-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-76d4c905-d819-48ba-9093-42340882b292" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-76d4c905-d819-48ba-9093-42340882b292" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-a928cff4-ae0f-42c6-9140-6cb9c6c00263" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-a928cff4-ae0f-42c6-9140-6cb9c6c00263" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Deleting offline snapshot a928cff4-ae0f-42c6-9140-6cb9c6c00263 of volume 76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] snapshot_file for this snap is: volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec16d4-8754-4981-8092-8d9a18d8bd12]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:53 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 Apr 21 21:00:53 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:53 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263" returned: 0 in 0.432s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d4c905-d819-48ba-9093-42340882b292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2febd0ac-d006-4ee5-bfcf-02fd27d565de]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:54 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 Apr 21 21:00:54 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:54 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292" returned: 0 in 0.443s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:54 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 Apr 21 21:00:54 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:54 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263" returned: 0 in 0.432s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:54 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263 Apr 21 21:00:54 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:55 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292.a928cff4-ae0f-42c6-9140-6cb9c6c00263" returned: 0 in 0.381s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-a928cff4-ae0f-42c6-9140-6cb9c6c00263" released by "_delete_snapshot" :: held 1.740s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-76d4c905-d819-48ba-9093-42340882b292" released by "delete_snapshot" :: held 1.750s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['3fb0e91e-af75-4760-b2b3-0f79ca253d95', '57143d1c-f5af-4660-ba2c-d7f83d08fb7a', '22b364e6-8000-4489-a11c-57ec684d9468', '0ca1b16d-a196-4eca-b398-13d2268206ae'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Delete snapshot completed successfully. Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c21f3a62-0d53-4140-bc6c-b5d680d4474f tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-a928cff4-ae0f-42c6-9140-6cb9c6c00263-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (828c4af6-f912-4435-baac-40f2216f3e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231cf311-15d8-4252-a44e-46de95716af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231cf311-15d8-4252-a44e-46de95716af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493910672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be886b9-7f95-4139-83fa-7ae46f2a9d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:56Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043a5d03-9f56-42bb-9fc2-4d60d420ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043a5d03-9f56-42bb-9fc2-4d60d420ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1834b-7d03-4241-ba74-4a79b1aec033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1834b-7d03-4241-ba74-4a79b1aec033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be886b9-7f95-4139-83fa-7ae46f2a9d81', 'volume_name': 'volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6356eb26-15e4-4c4b-a39f-0c1dd15c70d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6356eb26-15e4-4c4b-a39f-0c1dd15c70d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe7e331-3dd9-44d3-a5e4-3c2191b192ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:55 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Volume 2be886b9-7f95-4139-83fa-7ae46f2a9d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81', 'volume_size': 1} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493910672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be886b9-7f95-4139-83fa-7ae46f2a9d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:56Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Creating volume 2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:55 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:00:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:55 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 1073741824 Apr 21 21:00:55 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:56 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 1073741824" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:56 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:00:56 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:56 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.376s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe7e331-3dd9-44d3-a5e4-3c2191b192ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a4c27e-697f-4781-bce1-6260fec8f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Volume volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 (2be886b9-7f95-4139-83fa-7ae46f2a9d81): created successfully Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a4c27e-697f-4781-bce1-6260fec8f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (828c4af6-f912-4435-baac-40f2216f3e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:56 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f4c76d80-2b11-428d-9bce-336f21c87809 tempest-VolumesSnapshotTestJSON-673500952 None] Created volume successfully. Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Creating offline snapshot d9145c74-df99-448c-9e71-44a65cbd6308 of volume 2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[023bd17f-ae54-4f37-acf7-464e4a029ad8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:57 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:00:57 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:57 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.435s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:57 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 1G Apr 21 21:00:57 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:57 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 1G" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:57 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 Apr 21 21:00:57 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:58 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308" returned: 0 in 0.405s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:58 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 is being set with open permissions: ugo+rw Apr 21 21:00:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:58 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 Apr 21 21:00:58 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:58 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308" returned: 0 in 0.378s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:58 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info Apr 21 21:00:58 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:59 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info" returned: 0 in 0.395s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:59 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info is being set with open permissions: ugo+rw Apr 21 21:00:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:59 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info Apr 21 21:00:59 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:59 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.info" returned: 0 in 0.401s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8749730d-d33d-44f8-a3e8-df1b278a7fad tempest-VolumesSnapshotTestJSON-673500952 None] Create snapshot completed successfully Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (2b868c5a-7bb0-4edd-873c-17913b1d8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06912db-9d82-4374-9062-cd6294b95546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06912db-9d82-4374-9062-cd6294b95546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2122041795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600de1c2-976c-4919-b3c4-a6795719a685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d9145c74-df99-448c-9e71-44a65cbd6308,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:00Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fb85bc-faa4-4839-9d54-c1675b6ba35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fb85bc-faa4-4839-9d54-c1675b6ba35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141bd31c-bf6d-4c14-998b-6929eeaf9d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141bd31c-bf6d-4c14-998b-6929eeaf9d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '600de1c2-976c-4919-b3c4-a6795719a685', 'volume_name': 'volume-600de1c2-976c-4919-b3c4-a6795719a685', 'volume_size': 2, 'snapshot_id': 'd9145c74-df99-448c-9e71-44a65cbd6308'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1f1482-fcae-45a1-bed0-23a051d49635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1f1482-fcae-45a1-bed0-23a051d49635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af275cd2-14f5-4865-bc97-63f1dad84b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:00 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Volume 600de1c2-976c-4919-b3c4-a6795719a685: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-600de1c2-976c-4919-b3c4-a6795719a685', 'volume_size': 2, 'snapshot_id': 'd9145c74-df99-448c-9e71-44a65cbd6308'} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-d9145c74-df99-448c-9e71-44a65cbd6308-600de1c2-976c-4919-b3c4-a6795719a685" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-d9145c74-df99-448c-9e71-44a65cbd6308-600de1c2-976c-4919-b3c4-a6795719a685" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Creating volume 600de1c2-976c-4919-b3c4-a6795719a685 from snapshot d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-600de1c2-976c-4919-b3c4-a6795719a685" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-600de1c2-976c-4919-b3c4-a6795719a685" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] snapshot: d9145c74-df99-448c-9e71-44a65cbd6308, volume: 600de1c2-976c-4919-b3c4-a6795719a685, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b765db2e-748f-431e-89b1-62fa3a3cc32f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:00 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 Apr 21 21:01:00 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:00 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893c5cb-5550-4649-900c-19c532923fa9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:01 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:01:01 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:01 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.476s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:01 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:01:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:01 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 Apr 21 21:01:01 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:03 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685" returned: 0 in 1.913s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:03 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffa59f7-3256-4df8-9ba2-ac5ee6fe68a9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:03 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:01:03 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:03 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.610s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:03 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:03 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Converted 1024.00 MB image at 534.95 MB/s Apr 21 21:01:03 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 is being set with open permissions: ugo+rw Apr 21 21:01:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:03 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 Apr 21 21:01:03 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:04 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685" returned: 0 in 0.390s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-600de1c2-976c-4919-b3c4-a6795719a685" released by "_copy_volume_from_snapshot" :: held 3.902s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-d9145c74-df99-448c-9e71-44a65cbd6308-600de1c2-976c-4919-b3c4-a6795719a685" released by "_create_volume_from_snapshot" :: held 3.922s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.934s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:UPDATE=153,cinder:SELECT=127,cinder:INSERT=48,cinder:DELETE=8 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af275cd2-14f5-4865-bc97-63f1dad84b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600de1c2-976c-4919-b3c4-a6795719a685', 'volume_size': 2, 'snapshot_id': 'd9145c74-df99-448c-9e71-44a65cbd6308'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23829e0-f28e-4f0b-9bd5-fbb1fc5a4efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:04 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Volume volume-600de1c2-976c-4919-b3c4-a6795719a685 (600de1c2-976c-4919-b3c4-a6795719a685): created successfully Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23829e0-f28e-4f0b-9bd5-fbb1fc5a4efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (2b868c5a-7bb0-4edd-873c-17913b1d8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:04 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-276e6728-e4ee-47ff-a30e-6153e4da8f89 tempest-VolumesSnapshotTestJSON-673500952 None] Created volume successfully. Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-600de1c2-976c-4919-b3c4-a6795719a685-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-600de1c2-976c-4919-b3c4-a6795719a685-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-600de1c2-976c-4919-b3c4-a6795719a685" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-600de1c2-976c-4919-b3c4-a6795719a685" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[750752e7-5b33-4dc4-8d53-b5f4a1ea430b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:04 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 Apr 21 21:01:04 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:05 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:05 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685 Apr 21 21:01:05 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:05 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-600de1c2-976c-4919-b3c4-a6795719a685" returned: 0 in 0.404s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-600de1c2-976c-4919-b3c4-a6795719a685" released by "delete_volume" :: held 0.912s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['5657d616-1984-4ed5-b991-9d59af4f3d6f', 'a63ec0c3-7866-413f-8c15-7bbb62c82da8', 'e5c9d118-d881-4305-8722-5a66b6ef978d', 'd32d47db-f0c0-4ac6-b54c-87f3334e0321'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:05 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:05 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-d9145c74-df99-448c-9e71-44a65cbd6308-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-d9145c74-df99-448c-9e71-44a65cbd6308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-2be886b9-7f95-4139-83fa-7ae46f2a9d81" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-2be886b9-7f95-4139-83fa-7ae46f2a9d81" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-d9145c74-df99-448c-9e71-44a65cbd6308" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-d9145c74-df99-448c-9e71-44a65cbd6308" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Deleting offline snapshot d9145c74-df99-448c-9e71-44a65cbd6308 of volume 2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] snapshot_file for this snap is: volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[41406bd9-8cb3-4422-9948-76262aa02d5e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:05 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 Apr 21 21:01:05 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:06 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Deleted volume successfully. Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f33a0eea-dcde-437d-b30a-678d4ed5fc72 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-600de1c2-976c-4919-b3c4-a6795719a685-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:06 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a0fc41-83b6-4953-8ea9-3c82d2a9029a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:06 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:01:06 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:06 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:06 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 Apr 21 21:01:06 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:07 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:07 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308 Apr 21 21:01:07 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:07 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81.d9145c74-df99-448c-9e71-44a65cbd6308" returned: 0 in 0.429s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-d9145c74-df99-448c-9e71-44a65cbd6308" released by "_delete_snapshot" :: held 1.873s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-2be886b9-7f95-4139-83fa-7ae46f2a9d81" released by "delete_snapshot" :: held 1.884s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['3759e160-5d55-41a8-b09d-b4d3ca7aeaf8', 'c6d7c50a-d842-4e44-91ff-c141f12fc22b', '90c0e913-cac0-4d15-bda5-92a3b6603bc0', '3d419523-7fea-4abf-acca-e20cf51f5e32'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Delete snapshot completed successfully. Apr 21 21:01:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7431ef8a-f5ab-473c-97e7-cff02bfea379 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-d9145c74-df99-448c-9e71-44a65cbd6308-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-2be886b9-7f95-4139-83fa-7ae46f2a9d81-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-2be886b9-7f95-4139-83fa-7ae46f2a9d81-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-2be886b9-7f95-4139-83fa-7ae46f2a9d81" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-2be886b9-7f95-4139-83fa-7ae46f2a9d81" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[26517f6e-4fb9-4903-aac9-974a2de5b819]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:01:09 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:09 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81 Apr 21 21:01:09 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:09 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2be886b9-7f95-4139-83fa-7ae46f2a9d81" returned: 0 in 0.399s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-2be886b9-7f95-4139-83fa-7ae46f2a9d81" released by "delete_volume" :: held 0.877s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['5435e2f8-5cd6-4786-a115-2111a7fce52b', '9d188915-ca35-4c59-8ac4-b36e38d61b4b', '265de85f-4204-47bb-a0c1-34088b7e0802', '544cfecf-8c68-431f-be62-e50a68b9c28b'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:09 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:09 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (b8f505d1-8ec4-445a-9293-99ca9b186fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e3e0d2-4f79-408c-be47-60d257f27172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e3e0d2-4f79-408c-be47-60d257f27172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1822120728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af60e17-c666-45f5-87f0-0c8525a512d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:10Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cbd548-e198-4325-88e8-050d229bc557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cbd548-e198-4325-88e8-050d229bc557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdad4c8-f9c8-4318-8644-1bad25917622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdad4c8-f9c8-4318-8644-1bad25917622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af60e17-c666-45f5-87f0-0c8525a512d8', 'volume_name': 'volume-9af60e17-c666-45f5-87f0-0c8525a512d8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b619058-5b18-4fa6-8a21-1c2060c73156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b619058-5b18-4fa6-8a21-1c2060c73156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f7b877-580c-4a9e-935b-aa8e3f1a8fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:10 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Volume 9af60e17-c666-45f5-87f0-0c8525a512d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af60e17-c666-45f5-87f0-0c8525a512d8', 'volume_size': 1} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1822120728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af60e17-c666-45f5-87f0-0c8525a512d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:10Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Creating volume 9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:10 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:10 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.497s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:10 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Deleted volume successfully. Apr 21 21:01:10 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 1073741824 Apr 21 21:01:10 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c1632d73-7d1d-4881-9a96-e188f17bfa3b tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-2be886b9-7f95-4139-83fa-7ae46f2a9d81-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:10 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 1073741824" returned: 0 in 0.460s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:10 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:10 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:11 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.386s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f7b877-580c-4a9e-935b-aa8e3f1a8fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af60e17-c666-45f5-87f0-0c8525a512d8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3db8767-e5e2-4f57-940b-e1ffa95818b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:11 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Volume volume-9af60e17-c666-45f5-87f0-0c8525a512d8 (9af60e17-c666-45f5-87f0-0c8525a512d8): created successfully Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3db8767-e5e2-4f57-940b-e1ffa95818b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (b8f505d1-8ec4-445a-9293-99ca9b186fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:11 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4bcb5d1c-4084-401b-b70d-2d8697b26413 tempest-VolumesSnapshotTestJSON-673500952 None] Created volume successfully. Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Creating offline snapshot fa82cedc-289f-42e5-914a-f59942239e43 of volume 9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8964985-c28f-42fa-be35-b768e2975fc9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:11 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:11 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:11 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:11 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 1G Apr 21 21:01:11 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:12 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 1G" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af60e17-c666-45f5-87f0-0c8525a512d8 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:12 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af60e17-c666-45f5-87f0-0c8525a512d8 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 Apr 21 21:01:12 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:12 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af60e17-c666-45f5-87f0-0c8525a512d8 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43" returned: 0 in 0.407s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:12 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 is being set with open permissions: ugo+rw Apr 21 21:01:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:12 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 Apr 21 21:01:12 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43" returned: 0 in 0.380s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:13 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info Apr 21 21:01:13 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info" returned: 0 in 0.389s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info is being set with open permissions: ugo+rw Apr 21 21:01:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:13 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info Apr 21 21:01:13 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:13 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.info" returned: 0 in 0.387s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:14 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e4347c6a-5f49-47f7-a81f-5348b15d586a tempest-VolumesSnapshotTestJSON-673500952 None] Create snapshot completed successfully Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (98cb2927-d6e2-4a87-bdf4-4c0f60bcdd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5861e571-855b-4ae5-b0a1-1b1e2138bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5861e571-855b-4ae5-b0a1-1b1e2138bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-61828876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fbc4b1-1d3f-44a2-9dde-7f20bcef444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fab657376d848c9871c82d5743bd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa82cedc-289f-42e5-914a-f59942239e43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:15Z,use_quota=True,user_id='f8e24294738f4eaeb7e1727bbe49a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2859d3c4-7500-43bb-9d18-06c84697b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2859d3c4-7500-43bb-9d18-06c84697b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc68748-588c-49e0-b3eb-3d3b10ad2b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc68748-588c-49e0-b3eb-3d3b10ad2b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03fbc4b1-1d3f-44a2-9dde-7f20bcef444a', 'volume_name': 'volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a', 'volume_size': 1, 'snapshot_id': 'fa82cedc-289f-42e5-914a-f59942239e43'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508aa28c-e26e-4675-894b-770759a6ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508aa28c-e26e-4675-894b-770759a6ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4578e15c-8753-4c31-b24c-eb2a8f25d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:14 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Volume 03fbc4b1-1d3f-44a2-9dde-7f20bcef444a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a', 'volume_size': 1, 'snapshot_id': 'fa82cedc-289f-42e5-914a-f59942239e43'} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-fa82cedc-289f-42e5-914a-f59942239e43-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-fa82cedc-289f-42e5-914a-f59942239e43-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Creating volume 03fbc4b1-1d3f-44a2-9dde-7f20bcef444a from snapshot fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] snapshot: fa82cedc-289f-42e5-914a-f59942239e43, volume: 03fbc4b1-1d3f-44a2-9dde-7f20bcef444a, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15c99e-b540-44da-bb31-446835ec73e5]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 Apr 21 21:01:15 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:15 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43" returned: 0 in 0.452s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af60e17-c666-45f5-87f0-0c8525a512d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2660e8b1-3604-44d0-b0b3-7d9e671ff843]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:15 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:15 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:01:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:15 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a Apr 21 21:01:15 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:17 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" returned: 0 in 1.896s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:17 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa183a4f-83ee-419a-af53-d29f29976c80]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:17 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:17 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.573s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:18 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Converted 1024.00 MB image at 539.89 MB/s Apr 21 21:01:18 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a is being set with open permissions: ugo+rw Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:18 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a Apr 21 21:01:18 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" returned: 0 in 0.390s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" released by "_copy_volume_from_snapshot" :: held 3.818s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-fa82cedc-289f-42e5-914a-f59942239e43-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" released by "_create_volume_from_snapshot" :: held 3.834s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.842s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4578e15c-8753-4c31-b24c-eb2a8f25d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a', 'volume_size': 1, 'snapshot_id': 'fa82cedc-289f-42e5-914a-f59942239e43'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3526dd4c-b10f-4ea5-866e-47fa1b0b1943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Volume volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a (03fbc4b1-1d3f-44a2-9dde-7f20bcef444a): created successfully Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3526dd4c-b10f-4ea5-866e-47fa1b0b1943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Flow 'volume_create_manager' (98cb2927-d6e2-4a87-bdf4-4c0f60bcdd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:18 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-343a8870-3463-4f11-84ce-132830a2e7d8 tempest-VolumesSnapshotTestJSON-673500952 None] Created volume successfully. Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce8768-1f35-4b13-b4cf-68b9a3608be0]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:19 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a Apr 21 21:01:19 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:19 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:19 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a Apr 21 21:01:19 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" returned: 0 in 0.384s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a" released by "delete_volume" :: held 0.857s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['bbdf6427-b891-457d-a4b5-16ab8cff7aec', 'd5b582e3-3602-45b6-b498-a54a77af70f1', '2331c5c2-1bd7-43fa-8d40-cc8c52174361', 'befa41bd-f895-4c97-bc25-2454d6497846'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:20 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-fa82cedc-289f-42e5-914a-f59942239e43-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-fa82cedc-289f-42e5-914a-f59942239e43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-9af60e17-c666-45f5-87f0-0c8525a512d8" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-9af60e17-c666-45f5-87f0-0c8525a512d8" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-fa82cedc-289f-42e5-914a-f59942239e43" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-fa82cedc-289f-42e5-914a-f59942239e43" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Deleting offline snapshot fa82cedc-289f-42e5-914a-f59942239e43 of volume 9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] snapshot_file for this snap is: volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba369e8-0a28-45ca-8568-c107a640e940]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 Apr 21 21:01:20 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:20 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.415s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:20 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Deleted volume successfully. Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-66aaa1be-b202-44f1-ae57-bdc37a5848b8 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-03fbc4b1-1d3f-44a2-9dde-7f20bcef444a-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:20 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af60e17-c666-45f5-87f0-0c8525a512d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[740a7672-3b44-41e9-84c1-57f41f1cffa7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:20 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:20 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:21 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:21 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 Apr 21 21:01:21 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:21 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43" returned: 0 in 0.424s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:21 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43 Apr 21 21:01:21 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:22 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8.fa82cedc-289f-42e5-914a-f59942239e43" returned: 0 in 0.383s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-fa82cedc-289f-42e5-914a-f59942239e43" released by "_delete_snapshot" :: held 1.770s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-9af60e17-c666-45f5-87f0-0c8525a512d8" released by "delete_snapshot" :: held 1.783s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['33ee2a03-20bb-4022-82e6-9e34e0b370af', 'b49f521e-2b84-49aa-b35a-239a1af02757', '8217393d-abff-4f68-9e6c-540d0d7da14d', 'fced5b73-e12e-46da-9a31-39c8a44c5c0a'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:22 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Delete snapshot completed successfully. Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-be9ada64-1420-4ff8-b551-1f34bf0566d4 tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-fa82cedc-289f-42e5-914a-f59942239e43-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-9af60e17-c666-45f5-87f0-0c8525a512d8-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-9af60e17-c666-45f5-87f0-0c8525a512d8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-9af60e17-c666-45f5-87f0-0c8525a512d8" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-9af60e17-c666-45f5-87f0-0c8525a512d8" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a04d39b-57f7-4397-b66a-6f7a07bcca7c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:22 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:22 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.482s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8 Apr 21 21:01:23 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9af60e17-c666-45f5-87f0-0c8525a512d8" returned: 0 in 0.400s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-9af60e17-c666-45f5-87f0-0c8525a512d8" released by "delete_volume" :: held 0.918s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['79934ddb-767b-4890-a35b-f110b4558ca0', '0c001146-7677-4439-b3af-1fe1ccb593af', '4a72aec2-283d-41fb-9f2c-9195c94ea999', 'f520fe95-6b22-40be-9fcf-240044cd047f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:23 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-76d4c905-d819-48ba-9093-42340882b292-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-76d4c905-d819-48ba-9093-42340882b292-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "cinder-quobyte-76d4c905-d819-48ba-9093-42340882b292" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-76d4c905-d819-48ba-9093-42340882b292" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad761ade-c848-447f-9cc6-0a3a364b69e6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:23 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 Apr 21 21:01:23 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:23 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:23 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:23 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Deleted volume successfully. Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e6425793-e8cc-43ab-8219-feb4ba67753e tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-9af60e17-c666-45f5-87f0-0c8525a512d8-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:24 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:24 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292 Apr 21 21:01:24 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:24 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-76d4c905-d819-48ba-9093-42340882b292" returned: 0 in 0.382s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-quobyte-76d4c905-d819-48ba-9093-42340882b292" released by "delete_volume" :: held 0.865s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Created reservations ['18fdacbd-bf2c-4b00-9977-81c1eb37b78b', '421ad3b6-6168-4494-8bb5-a35647dcdfdf', 'e4b1c745-a874-495e-a3a0-842ee9efcca6', 'f7233957-9730-4f9d-a3e9-6cdc46e85d02'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:24 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:24 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:24 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:25 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:25 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:25 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Deleted volume successfully. Apr 21 21:01:25 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ef24b005-da55-4262-9170-b1f8076ce9eb tempest-VolumesSnapshotTestJSON-673500952 None] Lock "cinder-76d4c905-d819-48ba-9093-42340882b292-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Flow 'volume_create_manager' (195f5ed5-b28d-46ab-b21a-3975b136c01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a84be6f-e653-478a-bbaf-682843ab0198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a84be6f-e653-478a-bbaf-682843ab0198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1726475802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03483a89-c77b-44a1-831a-0a9dda20976c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09db9450f1d4b70aa4edfe87404afab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:28Z,use_quota=True,user_id='21556a0f466a44ac8d65391d786c8ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d140023-1f7e-4d77-8597-9a4d59e263f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d140023-1f7e-4d77-8597-9a4d59e263f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ddbb8e-5692-48fa-b31c-d1b91f682319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ddbb8e-5692-48fa-b31c-d1b91f682319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03483a89-c77b-44a1-831a-0a9dda20976c', 'volume_name': 'volume-03483a89-c77b-44a1-831a-0a9dda20976c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7df4aa8-d4f7-4cd7-8646-b02cd9e62af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7df4aa8-d4f7-4cd7-8646-b02cd9e62af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854b7165-723c-4d1d-b6e4-b3d7738ee0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:28 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Volume 03483a89-c77b-44a1-831a-0a9dda20976c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03483a89-c77b-44a1-831a-0a9dda20976c', 'volume_size': 1} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1726475802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03483a89-c77b-44a1-831a-0a9dda20976c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09db9450f1d4b70aa4edfe87404afab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:28Z,use_quota=True,user_id='21556a0f466a44ac8d65391d786c8ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Creating volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:28 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c 1073741824 Apr 21 21:01:28 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:28 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c 1073741824" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:28 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c Apr 21 21:01:28 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c" returned: 0 in 0.395s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854b7165-723c-4d1d-b6e4-b3d7738ee0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03483a89-c77b-44a1-831a-0a9dda20976c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c489977-87ff-4476-b685-12764e5fc31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:29 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Volume volume-03483a89-c77b-44a1-831a-0a9dda20976c (03483a89-c77b-44a1-831a-0a9dda20976c): created successfully Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c489977-87ff-4476-b685-12764e5fc31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Flow 'volume_create_manager' (195f5ed5-b28d-46ab-b21a-3975b136c01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2b336297-fefa-49d8-8dea-1f4cf2d49971 tempest-VolumesSnapshotListTestJSON-1065562147 None] Created volume successfully. Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Creating offline snapshot f09aaf72-8ca6-4b48-befa-5dfc7c4debcd of volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c20022c-265e-4cf6-86a0-c459a8ee6194]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:29 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c Apr 21 21:01:29 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:29 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c" returned: 0 in 0.452s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:30 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd 1G Apr 21 21:01:30 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:30 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd 1G" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:30 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:30 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:30 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.398s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:30 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd is being set with open permissions: ugo+rw Apr 21 21:01:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:30 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:30 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:31 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.378s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:31 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info Apr 21 21:01:31 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:31 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info" returned: 0 in 0.398s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:31 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info is being set with open permissions: ugo+rw Apr 21 21:01:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:31 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info Apr 21 21:01:31 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:32 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.info" returned: 0 in 0.384s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=108,cinder:DELETE=14,cinder:UPDATE=113,cinder:INSERT=26 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4c4602b7-6e02-4277-bf56-7c24142a56c2 tempest-VolumesSnapshotListTestJSON-1065562147 None] Create snapshot completed successfully Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Creating offline snapshot 6f9ca09b-4652-4081-8add-42e9f21af0c1 of volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b33486-8774-42bb-b8e4-20ed952af101]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:32 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:32 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:33 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.443s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:33 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 1G Apr 21 21:01:33 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:33 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 1G" returned: 0 in 0.451s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:33 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:33 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:34 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.406s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:34 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 is being set with open permissions: ugo+rw Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:34 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:34 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:34 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.430s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-06c75634-e84e-4cbd-aa1e-86c4cd86e35f tempest-VolumesSnapshotListTestJSON-1065562147 None] Create snapshot completed successfully Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Creating offline snapshot 51a153c2-e155-47f3-b78f-02d39bffab0f of volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3f7acc-7362-4116-a413-f9221fe289e6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:34 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:34 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:35 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.445s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:35 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f 1G Apr 21 21:01:35 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:35 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f 1G" returned: 0 in 0.476s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:35 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f Apr 21 21:01:35 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:36 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f" returned: 0 in 0.414s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:36 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f is being set with open permissions: ugo+rw Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:36 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f Apr 21 21:01:36 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_service.periodic_task [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82005) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:36 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:36 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:36 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:36 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8df30705-df56-4ec5-a22b-03cf1f7ed0ad tempest-VolumesSnapshotListTestJSON-1065562147 None] Create snapshot completed successfully Apr 21 21:01:36 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.399s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-4741df2b-6280-4ac7-901a-a7f98016c7cc None None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-51a153c2-e155-47f3-b78f-02d39bffab0f-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-51a153c2-e155-47f3-b78f-02d39bffab0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-51a153c2-e155-47f3-b78f-02d39bffab0f" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-51a153c2-e155-47f3-b78f-02d39bffab0f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Deleting offline snapshot 51a153c2-e155-47f3-b78f-02d39bffab0f of volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] snapshot_file for this snap is: volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f3865-03a5-49b2-b2b0-d567557c1900]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:37 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f Apr 21 21:01:37 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:37 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f" returned: 0 in 0.444s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:37 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63584ad-2f92-4d2e-8d61-2a91b6dcc407]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:38 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:38 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.451s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f Apr 21 21:01:38 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:38 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:38 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f Apr 21 21:01:38 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:39 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.51a153c2-e155-47f3-b78f-02d39bffab0f" returned: 0 in 0.382s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-51a153c2-e155-47f3-b78f-02d39bffab0f" released by "_delete_snapshot" :: held 1.783s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" released by "delete_snapshot" :: held 1.794s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Created reservations ['98fb01c7-2a22-4a4f-816f-283fd2d3dde2', 'a143a7a5-1b0c-4dc4-8870-2cd8896fd48d', 'fc11b13e-62a8-4a8c-a56a-fd6ca4656f07', '05f8de76-675a-48cb-a749-1ab4a69224e0'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:39 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Delete snapshot completed successfully. Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8eba698f-203e-43f5-80be-aef2dc697977 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-51a153c2-e155-47f3-b78f-02d39bffab0f-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-6f9ca09b-4652-4081-8add-42e9f21af0c1-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-6f9ca09b-4652-4081-8add-42e9f21af0c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-6f9ca09b-4652-4081-8add-42e9f21af0c1" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-6f9ca09b-4652-4081-8add-42e9f21af0c1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Deleting offline snapshot 6f9ca09b-4652-4081-8add-42e9f21af0c1 of volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] snapshot_file for this snap is: volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[168658ea-0735-4de9-b7c0-23f27fb49f62]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:39 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:39 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:40 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.439s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd742d1-6e4e-4c1d-92b3-0726dcdb3650]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:40 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:40 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:40 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:40 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.431s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:40 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1 Apr 21 21:01:40 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:41 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.6f9ca09b-4652-4081-8add-42e9f21af0c1" returned: 0 in 0.388s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-6f9ca09b-4652-4081-8add-42e9f21af0c1" released by "_delete_snapshot" :: held 1.745s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" released by "delete_snapshot" :: held 1.755s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Created reservations ['9d157071-6ad3-4676-9b08-5975eba57479', 'eae1779c-2a9a-4178-9c91-d6d6658b74a9', '835d7dcb-90b5-4eb8-8340-17b6e377a6cd', 'faa62540-30e2-4ffc-ab4f-a7617986d006'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Delete snapshot completed successfully. Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f940236-954e-4066-ab27-392d6f00ab74 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-6f9ca09b-4652-4081-8add-42e9f21af0c1-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-f09aaf72-8ca6-4b48-befa-5dfc7c4debcd-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-f09aaf72-8ca6-4b48-befa-5dfc7c4debcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Deleting offline snapshot f09aaf72-8ca6-4b48-befa-5dfc7c4debcd of volume 03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] snapshot_file for this snap is: volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fd5447-a716-4423-b1aa-7e3213d80279]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:41 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:41 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03483a89-c77b-44a1-831a-0a9dda20976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:01:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a46e7c5-7d88-41eb-b3ba-8a9035666576]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c Apr 21 21:01:42 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:42 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c" returned: 0 in 0.437s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:42 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd Apr 21 21:01:43 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c.f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" returned: 0 in 0.383s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-f09aaf72-8ca6-4b48-befa-5dfc7c4debcd" released by "_delete_snapshot" :: held 1.743s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" released by "delete_snapshot" :: held 1.755s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Created reservations ['c9257139-b118-40e5-91e8-e803a19c2b82', '4e002c69-0be0-43b9-b9da-e951a7f93658', '9b7326a9-cfb0-44ca-a282-6eacdb9db16d', '4d31d025-7a2f-45e2-8258-4fdbecaceea2'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Delete snapshot completed successfully. Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d71f934b-4000-4540-b688-5559510613c3 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-f09aaf72-8ca6-4b48-befa-5dfc7c4debcd-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-03483a89-c77b-44a1-831a-0a9dda20976c-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-03483a89-c77b-44a1-831a-0a9dda20976c-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[593459b0-e3f6-47fa-9d6b-22f6f2fa2310]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c Apr 21 21:01:43 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c" returned: 0 in 0.447s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:44 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c Apr 21 21:01:44 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03483a89-c77b-44a1-831a-0a9dda20976c" returned: 0 in 0.402s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-quobyte-03483a89-c77b-44a1-831a-0a9dda20976c" released by "delete_volume" :: held 0.885s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Created reservations ['e87b149f-8c0a-4838-953b-45c681b5fe6d', '58c849b3-8dd2-4203-b84c-5e798d54bde6', '6d11e94f-f47a-467a-b8cb-5f4749f53144', '058c5f29-178d-40d9-abee-c09735ed4ecb'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:44 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:01:44 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:45 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.459s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:45 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Deleted volume successfully. Apr 21 21:01:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-964ce24b-be2f-4b03-b344-b2888e146892 tempest-VolumesSnapshotListTestJSON-1065562147 None] Lock "cinder-03483a89-c77b-44a1-831a-0a9dda20976c-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (42c79532-4523-436e-a0f5-73c873bd3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed2e69f-27c9-431b-a95e-7dc0ba9bc8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed2e69f-27c9-431b-a95e-7dc0ba9bc8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-303160627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf33332-7386-4e96-bcea-e108abe85f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064cfac743ec4bb1ae3d2d9d032975b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='ee8a037afe6b46b4a188eb61b6642a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61450d25-d7a5-4c2f-81be-627c97acb1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61450d25-d7a5-4c2f-81be-627c97acb1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc460e8-f605-4edc-bce8-124d11b8270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc460e8-f605-4edc-bce8-124d11b8270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf33332-7386-4e96-bcea-e108abe85f68', 'volume_name': 'volume-bdf33332-7386-4e96-bcea-e108abe85f68', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a59821-20c8-4dbe-8b96-53ad35c36ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a59821-20c8-4dbe-8b96-53ad35c36ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e57736-0dcd-4383-bee3-5d47c7b9849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:51 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Volume bdf33332-7386-4e96-bcea-e108abe85f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf33332-7386-4e96-bcea-e108abe85f68', 'volume_size': 1} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-303160627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf33332-7386-4e96-bcea-e108abe85f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064cfac743ec4bb1ae3d2d9d032975b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='ee8a037afe6b46b4a188eb61b6642a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Creating volume bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:51 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 1073741824 Apr 21 21:01:51 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (fa5945b0-df40-41fc-be76-2cd9d1f7fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:51 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622026d5-9bab-49bf-89cc-bb69385e35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622026d5-9bab-49bf-89cc-bb69385e35a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1045802915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e8077b-48d0-4b9d-acff-b8877daf48d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822f81d3-186d-4328-872d-2c40c444e32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822f81d3-186d-4328-872d-2c40c444e32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b15aebc-43df-4396-a9f1-075f27bc1128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b15aebc-43df-4396-a9f1-075f27bc1128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e8077b-48d0-4b9d-acff-b8877daf48d9', 'volume_name': 'volume-67e8077b-48d0-4b9d-acff-b8877daf48d9', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd10c6bd-224f-4996-b938-d6dbe9fa9929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd10c6bd-224f-4996-b938-d6dbe9fa9929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361bead2-8958-431b-bf8f-89fcc65729e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume 67e8077b-48d0-4b9d-acff-b8877daf48d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e8077b-48d0-4b9d-acff-b8877daf48d9', 'volume_size': 1} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (f2c0109e-bca4-428d-ae4b-18636e999796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae9558a-d34a-4f95-862b-538f3b7d7fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae9558a-d34a-4f95-862b-538f3b7d7fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976574481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ec0a84-ffca-45a7-a628-ae159f3726db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8ccc21-ef5f-49da-a221-eb7dbe35d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8ccc21-ef5f-49da-a221-eb7dbe35d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e5d134-4596-4ec8-850d-dc9ea1d3c3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e5d134-4596-4ec8-850d-dc9ea1d3c3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ec0a84-ffca-45a7-a628-ae159f3726db', 'volume_name': 'volume-d3ec0a84-ffca-45a7-a628-ae159f3726db', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e471e3-4e6e-47d0-ba15-fe875e0c24e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e471e3-4e6e-47d0-ba15-fe875e0c24e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc3502-fc71-41ba-be20-cb4395224aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Volume d3ec0a84-ffca-45a7-a628-ae159f3726db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ec0a84-ffca-45a7-a628-ae159f3726db', 'volume_size': 1} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (2004371d-1dc5-40bc-8aaa-b05f7f27092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7064c8e0-c5f4-4f53-9c52-247d60b02ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7064c8e0-c5f4-4f53-9c52-247d60b02ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-997641063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eae68c5-7fd0-4aa0-aac0-167877ed3e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac462b5f-afe6-467b-b879-ecfcb5594639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac462b5f-afe6-467b-b879-ecfcb5594639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c8d590-aad9-40a8-9dc0-e5529f646a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c8d590-aad9-40a8-9dc0-e5529f646a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eae68c5-7fd0-4aa0-aac0-167877ed3e99', 'volume_name': 'volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4297888-af17-477a-ba79-c5f5fa91a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4297888-af17-477a-ba79-c5f5fa91a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b692dc-c78e-46a5-8842-67885163ec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Volume 1eae68c5-7fd0-4aa0-aac0-167877ed3e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99', 'volume_size': 1} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (680c4606-5b93-4706-b1f2-2efeefc41e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f217d3-e28b-4d5a-9e7b-26268c6522b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f217d3-e28b-4d5a-9e7b-26268c6522b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435255111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10552fe-d10c-4736-b991-49ed50e58812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913293b2-9fb1-4e23-a4f0-cae4693c2cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913293b2-9fb1-4e23-a4f0-cae4693c2cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61760f19-0367-4a9c-85a6-b4f9f5e7b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61760f19-0367-4a9c-85a6-b4f9f5e7b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10552fe-d10c-4736-b991-49ed50e58812', 'volume_name': 'volume-c10552fe-d10c-4736-b991-49ed50e58812', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e11917-3c75-49f2-9a26-902745110164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e11917-3c75-49f2-9a26-902745110164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ef0904-0104-4b9d-9a14-ac093ec40197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Volume c10552fe-d10c-4736-b991-49ed50e58812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10552fe-d10c-4736-b991-49ed50e58812', 'volume_size': 1} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 1073741824" returned: 0 in 0.633s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:52 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:01:52 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (850cf93d-77bf-4ebe-ab7b-30953aafa25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480429a9-4098-46ce-adb1-d0c3650fc546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480429a9-4098-46ce-adb1-d0c3650fc546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270406246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dfd224-c4a3-4074-a75f-033ee34714c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:53Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3462b494-ea39-4592-bb4a-979a6cec0f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3462b494-ea39-4592-bb4a-979a6cec0f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e1cbb7-8b1e-4313-97b8-69c50f58bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e1cbb7-8b1e-4313-97b8-69c50f58bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31dfd224-c4a3-4074-a75f-033ee34714c5', 'volume_name': 'volume-31dfd224-c4a3-4074-a75f-033ee34714c5', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae123d3-40cc-4de3-9558-c0e45f672aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae123d3-40cc-4de3-9558-c0e45f672aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5c7cf5-78ae-481b-a274-a778afd11f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Volume 31dfd224-c4a3-4074-a75f-033ee34714c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31dfd224-c4a3-4074-a75f-033ee34714c5', 'volume_size': 1} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (c126be00-3e5b-4388-9386-bcb9325cc682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec49f964-2824-47a0-9a8e-3317f1db631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec49f964-2824-47a0-9a8e-3317f1db631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1417612822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261597ee-8f67-47f4-b4fb-af043f976d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:53Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc4dd9b-1926-4570-91bb-d33665d1c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc4dd9b-1926-4570-91bb-d33665d1c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5eb3da-bfd8-41f4-bf2e-1169a9736c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5eb3da-bfd8-41f4-bf2e-1169a9736c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261597ee-8f67-47f4-b4fb-af043f976d75', 'volume_name': 'volume-261597ee-8f67-47f4-b4fb-af043f976d75', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93f4688-1fa3-4336-8535-9a8fd6e0d53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93f4688-1fa3-4336-8535-9a8fd6e0d53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a5b952-4ab9-44f0-b6a7-aac76d692a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:52 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Volume 261597ee-8f67-47f4-b4fb-af043f976d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261597ee-8f67-47f4-b4fb-af043f976d75', 'volume_size': 1} Apr 21 21:01:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:53 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.465s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1045802915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e8077b-48d0-4b9d-acff-b8877daf48d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Creating volume 67e8077b-48d0-4b9d-acff-b8877daf48d9 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:53 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 1073741824 Apr 21 21:01:53 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e57736-0dcd-4383-bee3-5d47c7b9849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf33332-7386-4e96-bcea-e108abe85f68', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ebc0da-591d-4ecf-a926-e479b3808f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:53 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Volume volume-bdf33332-7386-4e96-bcea-e108abe85f68 (bdf33332-7386-4e96-bcea-e108abe85f68): created successfully Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ebc0da-591d-4ecf-a926-e479b3808f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (42c79532-4523-436e-a0f5-73c873bd3e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2171b469-4c20-4918-9bba-8fbb51105e37 tempest-VolumeDependencyTests-1460809960 None] Created volume successfully. Apr 21 21:01:53 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 1073741824" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 Apr 21 21:01:53 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976574481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ec0a84-ffca-45a7-a628-ae159f3726db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Creating volume d3ec0a84-ffca-45a7-a628-ae159f3726db {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:54 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361bead2-8958-431b-bf8f-89fcc65729e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e8077b-48d0-4b9d-acff-b8877daf48d9', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:54 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db 1073741824 Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d731107-609c-4093-95fb-8c5f109bc777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:54 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 (67e8077b-48d0-4b9d-acff-b8877daf48d9): created successfully Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d731107-609c-4093-95fb-8c5f109bc777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (fa5945b0-df40-41fc-be76-2cd9d1f7fbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:54 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-75a3e98a-ec8c-486f-82a4-04b480bc6ee0 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created volume successfully. Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:54 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db 1073741824" returned: 0 in 0.554s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db Apr 21 21:01:54 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db" returned: 0 in 0.432s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.698s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-997641063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eae68c5-7fd0-4aa0-aac0-167877ed3e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Creating volume 1eae68c5-7fd0-4aa0-aac0-167877ed3e99 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:55 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc3502-fc71-41ba-be20-cb4395224aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ec0a84-ffca-45a7-a628-ae159f3726db', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c203e61-d94b-450d-94fb-763faf6a30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 1073741824 Apr 21 21:01:55 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Volume volume-d3ec0a84-ffca-45a7-a628-ae159f3726db (d3ec0a84-ffca-45a7-a628-ae159f3726db): created successfully Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c203e61-d94b-450d-94fb-763faf6a30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (f2c0109e-bca4-428d-ae4b-18636e999796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:55 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-40511022-f34e-4635-b6f5-e4236c2e2206 tempest-CreateVolumesFromImageTest-222687080 None] Created volume successfully. Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (f9530385-bb15-4e27-845f-a77b2c2b36c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845fc851-d3ff-4de1-abd8-c38d73af5b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845fc851-d3ff-4de1-abd8-c38d73af5b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-823710833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a49f802-7d1a-45a6-bb0b-317b89b69dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:55Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff2d429-95fb-45c5-ad45-a5d3bcac85cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff2d429-95fb-45c5-ad45-a5d3bcac85cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866e8aeb-4975-4cd8-a581-be88b00f7e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866e8aeb-4975-4cd8-a581-be88b00f7e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a49f802-7d1a-45a6-bb0b-317b89b69dc3', 'volume_name': 'volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc76bbc-9692-422a-a022-89fdabd3a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc76bbc-9692-422a-a022-89fdabd3a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e582d51-15d1-4265-a1e9-6a6505b22f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume 6a49f802-7d1a-45a6-bb0b-317b89b69dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3', 'volume_size': 1} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (11d5507d-b743-4629-bd0b-385405113d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52974a8-7da7-4b73-aa36-b356db766182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52974a8-7da7-4b73-aa36-b356db766182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-583410022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f355c36-23a1-422f-bd6f-0cc59b61810f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cbeea3-79ba-42e3-b371-2019c2992fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cbeea3-79ba-42e3-b371-2019c2992fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f05b73-34c8-4491-9525-aaa14e203099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f05b73-34c8-4491-9525-aaa14e203099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f355c36-23a1-422f-bd6f-0cc59b61810f', 'volume_name': 'volume-1f355c36-23a1-422f-bd6f-0cc59b61810f', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9836cc35-ce0b-4e94-a221-5de5ad6eafd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9836cc35-ce0b-4e94-a221-5de5ad6eafd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74990742-19a0-43ae-a323-12321f01f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume 1f355c36-23a1-422f-bd6f-0cc59b61810f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f355c36-23a1-422f-bd6f-0cc59b61810f', 'volume_size': 1} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:55 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 1073741824" returned: 0 in 0.820s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 Apr 21 21:01:55 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (583fc789-c841-4ae5-88ce-7e531255c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7eb5e20-d07d-4a0f-8b4c-63ce967fc92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7eb5e20-d07d-4a0f-8b4c-63ce967fc92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470146078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa78848-7fc6-4ee4-a523-45682fe47983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693ddd02-2912-4d44-9ba6-2433794bee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693ddd02-2912-4d44-9ba6-2433794bee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474e7221-9bf2-441f-ab71-97668da85c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:55 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474e7221-9bf2-441f-ab71-97668da85c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa78848-7fc6-4ee4-a523-45682fe47983', 'volume_name': 'volume-bfa78848-7fc6-4ee4-a523-45682fe47983', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ac5ef8-3645-436b-9744-192f4e99eac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ac5ef8-3645-436b-9744-192f4e99eac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e31a16-4026-4596-8592-5cd1e5317916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume bfa78848-7fc6-4ee4-a523-45682fe47983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa78848-7fc6-4ee4-a523-45682fe47983', 'volume_size': 1} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (8c8406ba-c21f-4204-9d40-eef1c93a6ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e9824d-6cd0-4815-90a9-56a0816fe6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e9824d-6cd0-4815-90a9-56a0816fe6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531065610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e97374f-719c-4736-8b86-eb55009ece4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7816eeb1-acd3-477f-a467-91ab0f18602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7816eeb1-acd3-477f-a467-91ab0f18602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09747d1-991b-46f2-b3cf-1e7cd7fb7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09747d1-991b-46f2-b3cf-1e7cd7fb7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e97374f-719c-4736-8b86-eb55009ece4d', 'volume_name': 'volume-2e97374f-719c-4736-8b86-eb55009ece4d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8511e2-ecb7-4501-bdff-9319f8afa7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8511e2-ecb7-4501-bdff-9319f8afa7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154a2d0b-39ba-4ab7-8ab3-c8c0bf796af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume 2e97374f-719c-4736-8b86-eb55009ece4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e97374f-719c-4736-8b86-eb55009ece4d', 'volume_size': 1} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (28f03587-134c-453a-aa0b-c36b374d5bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf21448f-fcff-4713-8d0d-5e2d23306ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf21448f-fcff-4713-8d0d-5e2d23306ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910998626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e14ced-0e17-4456-9ed2-233ecc9848af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e33e53-a27f-4891-9f38-64058e9f4fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e33e53-a27f-4891-9f38-64058e9f4fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3492324e-946e-43d5-852a-208ca63644c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3492324e-946e-43d5-852a-208ca63644c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e14ced-0e17-4456-9ed2-233ecc9848af', 'volume_name': 'volume-80e14ced-0e17-4456-9ed2-233ecc9848af', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b75bd0-de68-4988-a048-df6512d0ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b75bd0-de68-4988-a048-df6512d0ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3cc051-24c9-4ea2-baa4-f6f1d1d277ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume 80e14ced-0e17-4456-9ed2-233ecc9848af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e14ced-0e17-4456-9ed2-233ecc9848af', 'volume_size': 1} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99" returned: 0 in 0.601s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.917s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435255111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10552fe-d10c-4736-b991-49ed50e58812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:52Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Creating volume c10552fe-d10c-4736-b991-49ed50e58812 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:56 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b692dc-c78e-46a5-8842-67885163ec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc57ceeb-bdf6-4966-8970-3c3ba1d18a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:56 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 1073741824 Apr 21 21:01:56 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Volume volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 (1eae68c5-7fd0-4aa0-aac0-167877ed3e99): created successfully Apr 21 21:01:56 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc57ceeb-bdf6-4966-8970-3c3ba1d18a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:56 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (2004371d-1dc5-40bc-8aaa-b05f7f27092a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:56 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ba9abf92-43f8-465d-bd15-48ecdfeba5cf tempest-CreateVolumesFromImageTest-222687080 None] Created volume successfully. Apr 21 21:01:57 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 1073741824" returned: 0 in 0.531s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:57 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 Apr 21 21:01:57 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:57 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.744s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270406246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dfd224-c4a3-4074-a75f-033ee34714c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:53Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Creating volume 31dfd224-c4a3-4074-a75f-033ee34714c5 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:57 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ef0904-0104-4b9d-9a14-ac093ec40197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10552fe-d10c-4736-b991-49ed50e58812', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49a6951-514c-414c-82e2-b9805ab2c5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:57 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Volume volume-c10552fe-d10c-4736-b991-49ed50e58812 (c10552fe-d10c-4736-b991-49ed50e58812): created successfully Apr 21 21:01:57 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 1073741824 Apr 21 21:01:57 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49a6951-514c-414c-82e2-b9805ab2c5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:57 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (680c4606-5b93-4706-b1f2-2efeefc41e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:57 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d8ff467a-7c24-403d-9377-6a3c9e9168bb tempest-CreateVolumesFromImageTest-222687080 None] Created volume successfully. Apr 21 21:01:58 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 1073741824" returned: 0 in 0.543s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:58 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 Apr 21 21:01:58 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:58 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5" returned: 0 in 0.460s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.589s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1417612822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261597ee-8f67-47f4-b4fb-af043f976d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358cde27be1d470e83553a720882e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:53Z,use_quota=True,user_id='04746cd5c51c418f83314e4e6b78d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Creating volume 261597ee-8f67-47f4-b4fb-af043f976d75 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:58 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:58 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 1073741824 Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5c7cf5-78ae-481b-a274-a778afd11f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31dfd224-c4a3-4074-a75f-033ee34714c5', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:58 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed73d25-b78b-41ec-b37a-4f1777fbc324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:58 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Volume volume-31dfd224-c4a3-4074-a75f-033ee34714c5 (31dfd224-c4a3-4074-a75f-033ee34714c5): created successfully Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed73d25-b78b-41ec-b37a-4f1777fbc324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:58 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (850cf93d-77bf-4ebe-ab7b-30953aafa25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:58 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6b705826-8021-4ec8-ae74-81f7927e9e17 tempest-CreateVolumesFromImageTest-222687080 None] Created volume successfully. Apr 21 21:01:59 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 1073741824" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:59 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 Apr 21 21:01:59 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:59 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.454s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a5b952-4ab9-44f0-b6a7-aac76d692a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261597ee-8f67-47f4-b4fb-af043f976d75', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fa4ee4-159d-4c26-8b61-c7465f15ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Creating offline snapshot 80be0630-a55c-4093-b75c-350a2fedd829 of volume bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:01:59 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Volume volume-261597ee-8f67-47f4-b4fb-af043f976d75 (261597ee-8f67-47f4-b4fb-af043f976d75): created successfully Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fa4ee4-159d-4c26-8b61-c7465f15ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Flow 'volume_create_manager' (c126be00-3e5b-4388-9386-bcb9325cc682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd54be-0f62-453e-a24b-ac56d16b6290]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:59 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:59 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e808c1c3-a636-47a5-9a00-feec03112da2 tempest-CreateVolumesFromImageTest-222687080 None] Created volume successfully. Apr 21 21:01:59 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:01:59 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:00 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.543s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:00 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 1G Apr 21 21:02:00 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-261597ee-8f67-47f4-b4fb-af043f976d75-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-261597ee-8f67-47f4-b4fb-af043f976d75-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-quobyte-261597ee-8f67-47f4-b4fb-af043f976d75" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-261597ee-8f67-47f4-b4fb-af043f976d75" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7a3404-2a8d-4c31-a8a1-febafd88e08d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:00 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 Apr 21 21:02:00 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:00 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 1G" returned: 0 in 0.550s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:00 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdf33332-7386-4e96-bcea-e108abe85f68 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:00 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdf33332-7386-4e96-bcea-e108abe85f68 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 Apr 21 21:02:00 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:01 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75" returned: 0 in 0.494s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75 Apr 21 21:02:01 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:01 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdf33332-7386-4e96-bcea-e108abe85f68 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829" returned: 0 in 0.489s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:01 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 is being set with open permissions: ugo+rw Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 Apr 21 21:02:01 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:01 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-261597ee-8f67-47f4-b4fb-af043f976d75" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-261597ee-8f67-47f4-b4fb-af043f976d75" released by "delete_volume" :: held 0.961s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Created reservations ['c4048bfd-953e-4df9-8a5b-85dbd4fc0b23', 'b65fe37e-1eec-4fc0-9617-580444507c92', '1c53111d-d945-4bdb-8291-ed40ad623bcb', 'e88724a7-4e71-4dbf-b1e7-1942e95eb16e'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-31dfd224-c4a3-4074-a75f-033ee34714c5-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:01 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:01 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:01 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-31dfd224-c4a3-4074-a75f-033ee34714c5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info Apr 21 21:02:01 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-quobyte-31dfd224-c4a3-4074-a75f-033ee34714c5" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-31dfd224-c4a3-4074-a75f-033ee34714c5" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[596cfd27-fc88-4ceb-8ecf-0e535e0cf71a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:01 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 Apr 21 21:02:01 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:02 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info" returned: 0 in 0.434s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info is being set with open permissions: ugo+rw Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:02 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.552s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Deleted volume successfully. Apr 21 21:02:02 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info Apr 21 21:02:02 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-93bd6b35-0aac-40ba-ba30-eab39563143a tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-261597ee-8f67-47f4-b4fb-af043f976d75-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:02 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:02 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5 Apr 21 21:02:02 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:02 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.info" returned: 0 in 0.456s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.186s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-823710833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a49f802-7d1a-45a6-bb0b-317b89b69dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:55Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Creating volume 6a49f802-7d1a-45a6-bb0b-317b89b69dc3 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:02 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:02 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 1073741824 Apr 21 21:02:02 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:02 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5f43ef32-b0ec-4ce4-953f-499b9b9e4030 tempest-VolumeDependencyTests-1460809960 None] Create snapshot completed successfully Apr 21 21:02:02 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-31dfd224-c4a3-4074-a75f-033ee34714c5" returned: 0 in 0.490s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-31dfd224-c4a3-4074-a75f-033ee34714c5" released by "delete_volume" :: held 1.031s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Created reservations ['380d08bd-8d85-4077-a4cc-ac7cf46bbba0', '3ec711f5-1724-4235-81b3-c913acafbc42', '44e95325-7743-435d-88ba-6baa219a7c53', '80108132-828c-4936-a9cf-ee301e4271b6'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:02 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:02 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:02 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:03 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 1073741824" returned: 0 in 0.599s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:03 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 Apr 21 21:02:03 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:03 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.518s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:03 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Deleted volume successfully. Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-17454019-dce2-487d-890a-af9c9071d836 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-31dfd224-c4a3-4074-a75f-033ee34714c5-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (db0a4fe3-d9af-48da-9e4b-601270f000af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25784a0f-1f7e-4aec-a41b-d94964e72397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25784a0f-1f7e-4aec-a41b-d94964e72397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1381092504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5a119a-9f0b-4c01-b631-97c6c8ef4380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064cfac743ec4bb1ae3d2d9d032975b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80be0630-a55c-4093-b75c-350a2fedd829,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:04Z,use_quota=True,user_id='ee8a037afe6b46b4a188eb61b6642a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af3b1bb-e142-409c-915b-669d62b533b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af3b1bb-e142-409c-915b-669d62b533b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85770095-0d3a-4121-82fb-74dd40acb9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85770095-0d3a-4121-82fb-74dd40acb9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b5a119a-9f0b-4c01-b631-97c6c8ef4380', 'volume_name': 'volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380', 'volume_size': 1, 'snapshot_id': '80be0630-a55c-4093-b75c-350a2fedd829'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744fad84-9188-4bdb-8c43-203d9b00883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744fad84-9188-4bdb-8c43-203d9b00883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84567f1-4381-4aba-848f-54900805ad1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:03 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Volume 7b5a119a-9f0b-4c01-b631-97c6c8ef4380: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380', 'volume_size': 1, 'snapshot_id': '80be0630-a55c-4093-b75c-350a2fedd829'} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-c10552fe-d10c-4736-b991-49ed50e58812-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-c10552fe-d10c-4736-b991-49ed50e58812-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-quobyte-c10552fe-d10c-4736-b991-49ed50e58812" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-c10552fe-d10c-4736-b991-49ed50e58812" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a418dd5d-10ad-4d70-a6e6-3554aa53e9d9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:03 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3" returned: 0 in 0.706s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.287s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-583410022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f355c36-23a1-422f-bd6f-0cc59b61810f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Creating volume 1f355c36-23a1-422f-bd6f-0cc59b61810f {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:03 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:04 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e582d51-15d1-4265-a1e9-6a6505b22f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:04 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f 1073741824 Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a744aea7-19da-41f1-b49b-2775bffe6f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:04 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:04 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 (6a49f802-7d1a-45a6-bb0b-317b89b69dc3): created successfully Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a744aea7-19da-41f1-b49b-2775bffe6f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (f9530385-bb15-4e27-845f-a77b2c2b36c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:04 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3a49a695-59a1-4f98-a312-3fe8d26ed38d tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created volume successfully. Apr 21 21:02:04 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 Apr 21 21:02:04 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:04 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812" returned: 0 in 0.613s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:04 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812 Apr 21 21:02:04 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:04 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f 1073741824" returned: 0 in 0.616s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:DELETE=13,cinder:SELECT=102,cinder:INSERT=35,cinder:UPDATE=142 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:02:04 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:04 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f Apr 21 21:02:04 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-c10552fe-d10c-4736-b991-49ed50e58812" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-c10552fe-d10c-4736-b991-49ed50e58812" released by "delete_volume" :: held 1.133s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Created reservations ['1eb12070-d1a8-40c9-a3fb-f1eac5115dc1', 'a2501ff5-f6c9-45ee-a87a-05944fe3d684', '3085b5ef-aebc-4738-b933-619ac5699cea', '4ad802a7-7805-4982-a8b8-2c156862bbeb'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:05 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.114s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470146078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa78848-7fc6-4ee4-a523-45682fe47983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Creating volume bfa78848-7fc6-4ee4-a523-45682fe47983 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:05 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:05 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 1073741824 Apr 21 21:02:05 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74990742-19a0-43ae-a323-12321f01f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f355c36-23a1-422f-bd6f-0cc59b61810f', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8385ec-f8aa-4b3b-b3fa-841d4f13eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:05 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume volume-1f355c36-23a1-422f-bd6f-0cc59b61810f (1f355c36-23a1-422f-bd6f-0cc59b61810f): created successfully Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8385ec-f8aa-4b3b-b3fa-841d4f13eef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (11d5507d-b743-4629-bd0b-385405113d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-01a1c56d-7aec-4acf-a518-e15323090c91 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created volume successfully. Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:05 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:05 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 1073741824" returned: 0 in 0.497s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:05 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 Apr 21 21:02:05 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.511s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:05 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Deleted volume successfully. Apr 21 21:02:05 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-2e8e4576-4f3a-40ea-ac78-a547de306adc tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-c10552fe-d10c-4736-b991-49ed50e58812-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-1eae68c5-7fd0-4aa0-aac0-167877ed3e99-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-1eae68c5-7fd0-4aa0-aac0-167877ed3e99-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-quobyte-1eae68c5-7fd0-4aa0-aac0-167877ed3e99" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-1eae68c5-7fd0-4aa0-aac0-167877ed3e99" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc44fbd1-8e7e-4c2d-b04d-e80681512055]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:06 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983" returned: 0 in 0.535s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.926s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531065610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e97374f-719c-4736-8b86-eb55009ece4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:06 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 Apr 21 21:02:06 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Creating volume 2e97374f-719c-4736-8b86-eb55009ece4d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:06 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e31a16-4026-4596-8592-5cd1e5317916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa78848-7fc6-4ee4-a523-45682fe47983', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec10143-f4f1-43a9-9ae6-afdce28321a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:06 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume volume-bfa78848-7fc6-4ee4-a523-45682fe47983 (bfa78848-7fc6-4ee4-a523-45682fe47983): created successfully Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec10143-f4f1-43a9-9ae6-afdce28321a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (583fc789-c841-4ae5-88ce-7e531255c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:06 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d 1073741824 Apr 21 21:02:06 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:06 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6eff5aa4-16f4-4b0b-b6a5-7d4e6e5c57f7 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created volume successfully. Apr 21 21:02:06 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99" returned: 0 in 0.576s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:06 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99 Apr 21 21:02:06 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:06 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d 1073741824" returned: 0 in 0.546s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:06 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:06 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d Apr 21 21:02:06 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:07 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1eae68c5-7fd0-4aa0-aac0-167877ed3e99" returned: 0 in 0.488s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-1eae68c5-7fd0-4aa0-aac0-167877ed3e99" released by "delete_volume" :: held 1.100s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Created reservations ['67a81051-0905-4cdb-8ed2-a52d79f6bf41', '46fff1fe-6329-401a-bf68-e9a0e7620944', 'e1c6a1af-89f9-42d0-b94a-5538156996f5', '07b09700-2cdc-45e9-90a9-282d4a061d85'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:07 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:07 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:07 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d" returned: 0 in 0.576s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.899s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910998626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e14ced-0e17-4456-9ed2-233ecc9848af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec70e56a16ad4f2f8257213bdb3dfdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:56Z,use_quota=True,user_id='4cfbd3f17d1d430ea7b1043390fb3f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Creating volume 80e14ced-0e17-4456-9ed2-233ecc9848af {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:07 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154a2d0b-39ba-4ab7-8ab3-c8c0bf796af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e97374f-719c-4736-8b86-eb55009ece4d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8463388e-cde0-410c-84c2-cbcee8854672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:07 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af 1073741824 Apr 21 21:02:07 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:07 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume volume-2e97374f-719c-4736-8b86-eb55009ece4d (2e97374f-719c-4736-8b86-eb55009ece4d): created successfully Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8463388e-cde0-410c-84c2-cbcee8854672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (8c8406ba-c21f-4204-9d40-eef1c93a6ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7a7deecb-5e72-4ff5-8169-318bbd0045c2 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created volume successfully. Apr 21 21:02:07 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:07 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Deleted volume successfully. Apr 21 21:02:07 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d939c914-d9d1-4e36-8245-d6210eed048b tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-1eae68c5-7fd0-4aa0-aac0-167877ed3e99-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:07 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af 1073741824" returned: 0 in 0.625s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:08 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af Apr 21 21:02:08 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-d3ec0a84-ffca-45a7-a628-ae159f3726db-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-d3ec0a84-ffca-45a7-a628-ae159f3726db-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "cinder-quobyte-d3ec0a84-ffca-45a7-a628-ae159f3726db" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-d3ec0a84-ffca-45a7-a628-ae159f3726db" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146bfd9-5e2d-4535-8c2a-6027f96878a6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:08 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db Apr 21 21:02:08 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Flow 'volume_create_manager' (f0cdf3be-5cce-46f9-97cf-a3c54a1f7487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5413595a-8670-4cc4-b3bc-897602d02d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5413595a-8670-4cc4-b3bc-897602d02d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-382684813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446e9b85-f080-4650-88f3-5990c3036d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4c867015c4ebb905a0adc41602d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:08Z,use_quota=True,user_id='08187d5cb5df45d9ba946e5f97e84033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa733285-0d86-4634-a6be-08df8d4387e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa733285-0d86-4634-a6be-08df8d4387e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb07810-4b41-4125-b3a7-7e0acf763dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb07810-4b41-4125-b3a7-7e0acf763dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446e9b85-f080-4650-88f3-5990c3036d84', 'volume_name': 'volume-446e9b85-f080-4650-88f3-5990c3036d84', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:08 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711ee1d3-27d6-4e89-ab1b-0256d5d86819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711ee1d3-27d6-4e89-ab1b-0256d5d86819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44db529-7316-42bd-a7ec-a9672cf8da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:08 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Volume 446e9b85-f080-4650-88f3-5990c3036d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446e9b85-f080-4650-88f3-5990c3036d84', 'volume_size': 1} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af" returned: 0 in 0.535s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.660s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-80be0630-a55c-4093-b75c-350a2fedd829-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3cc051-24c9-4ea2-baa4-f6f1d1d277ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e14ced-0e17-4456-9ed2-233ecc9848af', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c118fc30-8f2a-411c-b3ed-656b8e265e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-80be0630-a55c-4093-b75c-350a2fedd829-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Creating volume 7b5a119a-9f0b-4c01-b631-97c6c8ef4380 from snapshot 80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:08 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Volume volume-80e14ced-0e17-4456-9ed2-233ecc9848af (80e14ced-0e17-4456-9ed2-233ecc9848af): created successfully Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c118fc30-8f2a-411c-b3ed-656b8e265e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Flow 'volume_create_manager' (28f03587-134c-453a-aa0b-c36b374d5bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] snapshot: 80be0630-a55c-4093-b75c-350a2fedd829, volume: 7b5a119a-9f0b-4c01-b631-97c6c8ef4380, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:02:08 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-88a685ed-56ee-4313-b50f-a65610036baf tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created volume successfully. Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e6c42-b8a8-4720-9139-80ed5264d910]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:08 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 Apr 21 21:02:08 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:08 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db" returned: 0 in 0.526s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:08 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:08 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db Apr 21 21:02:08 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829" returned: 0 in 0.456s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdf33332-7386-4e96-bcea-e108abe85f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8488d-303c-4d47-9f25-20d0630a27f4]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:02:09 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-80e14ced-0e17-4456-9ed2-233ecc9848af-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-80e14ced-0e17-4456-9ed2-233ecc9848af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:09 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-d3ec0a84-ffca-45a7-a628-ae159f3726db" returned: 0 in 0.470s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-quobyte-d3ec0a84-ffca-45a7-a628-ae159f3726db" released by "delete_volume" :: held 1.041s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-quobyte-80e14ced-0e17-4456-9ed2-233ecc9848af" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-80e14ced-0e17-4456-9ed2-233ecc9848af" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae649a-be17-46b6-b16f-e486582b5575]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Created reservations ['a5b9f5b5-4b86-4f88-b6f1-022d521ba695', '04ae1e4d-bb5b-4b4d-a257-d5440d68db53', '9b9fe7e9-aabf-4776-a889-173218c099b8', '094b3e88-5e60-4dfd-9fa1-35860df3dc56'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af Apr 21 21:02:09 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:09 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.495s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 Apr 21 21:02:09 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af" returned: 0 in 0.500s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:09 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Deleted volume successfully. Apr 21 21:02:09 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af Apr 21 21:02:09 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ab960322-ffe3-4f6e-a4d9-7426c4055b71 tempest-CreateVolumesFromImageTest-222687080 None] Lock "cinder-d3ec0a84-ffca-45a7-a628-ae159f3726db-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:10 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:10 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-80e14ced-0e17-4456-9ed2-233ecc9848af" returned: 0 in 0.931s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:10 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-80e14ced-0e17-4456-9ed2-233ecc9848af" released by "delete_volume" :: held 1.458s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:10 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created reservations ['55de5fc7-9f17-4437-a1f9-3eba45630bdf', '6d6ac326-4478-44b0-86d2-fa840fe5b8f9', 'd679deb2-b347-4b9e-8d44-5366e6e16e45', 'd28e884d-4175-4cf0-a38d-a6f9cad7dfce'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:11 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:11 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-2e97374f-719c-4736-8b86-eb55009ece4d-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-2e97374f-719c-4736-8b86-eb55009ece4d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-quobyte-2e97374f-719c-4736-8b86-eb55009ece4d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-2e97374f-719c-4736-8b86-eb55009ece4d" acquired by "delete_volume" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ecf665-7062-4671-8529-3121c7e7097b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:11 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:11 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d Apr 21 21:02:12 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:12 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" returned: 0 in 2.422s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dd32fd-06a9-4619-bf42-db78092415d2]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:12 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:02:12 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:12 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 1.131s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:12 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Deleted volume successfully. Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7a76f377-4501-4b0a-87af-ec51b3eb5150 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-80e14ced-0e17-4456-9ed2-233ecc9848af-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:12 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d" returned: 0 in 0.659s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:12 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d Apr 21 21:02:12 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:12 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.655s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:02:12 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Converted 1024.00 MB image at 422.64 MB/s Apr 21 21:02:12 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 is being set with open permissions: ugo+rw Apr 21 21:02:12 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:12 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 Apr 21 21:02:12 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:13 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-2e97374f-719c-4736-8b86-eb55009ece4d" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-2e97374f-719c-4736-8b86-eb55009ece4d" released by "delete_volume" :: held 1.206s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created reservations ['268d5bef-70ed-436d-bc0d-efa7854769e0', '89734077-085d-449e-a356-ddb51b89d14b', '8703a2a3-1a0f-4bb9-94f0-e1860c5b3f82', '7604e84b-6ccb-40d3-a7d6-48b6673788e8'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:13 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" released by "_copy_volume_from_snapshot" :: held 4.562s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-80be0630-a55c-4093-b75c-350a2fedd829-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" released by "_create_volume_from_snapshot" :: held 4.593s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.615s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:13 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:13 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.625s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-382684813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446e9b85-f080-4650-88f3-5990c3036d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4c867015c4ebb905a0adc41602d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:08Z,use_quota=True,user_id='08187d5cb5df45d9ba946e5f97e84033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Creating volume 446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:13 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:13 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 1073741824 Apr 21 21:02:13 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84567f1-4381-4aba-848f-54900805ad1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380', 'volume_size': 1, 'snapshot_id': '80be0630-a55c-4093-b75c-350a2fedd829'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90887b10-a6f5-4a8d-995a-9418dc6b7549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:13 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Volume volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 (7b5a119a-9f0b-4c01-b631-97c6c8ef4380): created successfully Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90887b10-a6f5-4a8d-995a-9418dc6b7549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (db0a4fe3-d9af-48da-9e4b-601270f000af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:13 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-5f016465-478b-4c28-888b-e31b1c9ef6c7 tempest-VolumeDependencyTests-1460809960 None] Created volume successfully. Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (2f11579f-4291-4887-b347-e6045d4e7735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990b78a8-2a34-4231-8c2f-14e13420b48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-80be0630-a55c-4093-b75c-350a2fedd829-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990b78a8-2a34-4231-8c2f-14e13420b48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476262248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c4d168-eaa2-48ed-bc4b-f9d624ae2532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:13Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4448ea3a-ca13-4de1-b1f9-7faaa74f3f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4448ea3a-ca13-4de1-b1f9-7faaa74f3f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ade0f91-e3d1-4fd2-9405-d0dfcfd6611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ade0f91-e3d1-4fd2-9405-d0dfcfd6611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c4d168-eaa2-48ed-bc4b-f9d624ae2532', 'volume_name': 'volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd89f401-92fb-4d7b-9685-30098bdb6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd89f401-92fb-4d7b-9685-30098bdb6b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd790494-4257-4de1-9d9c-af2ed5057ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:13 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume 43c4d168-eaa2-48ed-bc4b-f9d624ae2532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532', 'volume_size': 1} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-80be0630-a55c-4093-b75c-350a2fedd829-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-bdf33332-7386-4e96-bcea-e108abe85f68" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-bdf33332-7386-4e96-bcea-e108abe85f68" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-80be0630-a55c-4093-b75c-350a2fedd829" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-80be0630-a55c-4093-b75c-350a2fedd829" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Deleting offline snapshot 80be0630-a55c-4093-b75c-350a2fedd829 of volume bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] snapshot_file for this snap is: volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c82ba09-371d-4962-9f7b-89bc4f50bb41]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:13 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 Apr 21 21:02:13 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:13 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.536s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:13 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Deleted volume successfully. Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-bec60acd-4424-4887-9703-ea2fa2fce42e tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-2e97374f-719c-4736-8b86-eb55009ece4d-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:13 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 1073741824" returned: 0 in 0.658s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:13 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:13 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-bfa78848-7fc6-4ee4-a523-45682fe47983-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:13 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-bfa78848-7fc6-4ee4-a523-45682fe47983-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-quobyte-bfa78848-7fc6-4ee4-a523-45682fe47983" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-bfa78848-7fc6-4ee4-a523-45682fe47983" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145ec35-3700-4399-8e66-88950571852f]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:14 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829" returned: 0 in 0.540s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdf33332-7386-4e96-bcea-e108abe85f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d457f97-c989-487d-b764-03911efe3dd6]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:14 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 Apr 21 21:02:14 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:14 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:02:14 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:14 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476262248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c4d168-eaa2-48ed-bc4b-f9d624ae2532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:13Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating volume 43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:14 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44db529-7316-42bd-a7ec-a9672cf8da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446e9b85-f080-4650-88f3-5990c3036d84', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058224ed-e1da-4e90-8163-474d9ed563ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:14 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 1073741824 Apr 21 21:02:14 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:14 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Volume volume-446e9b85-f080-4650-88f3-5990c3036d84 (446e9b85-f080-4650-88f3-5990c3036d84): created successfully Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058224ed-e1da-4e90-8163-474d9ed563ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Flow 'volume_create_manager' (f0cdf3be-5cce-46f9-97cf-a3c54a1f7487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:14 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-872469d3-a2fe-402d-8401-eb6bf0579a4a tempest-SnapshotDependencyTests-1569109630 None] Created volume successfully. Apr 21 21:02:14 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:14 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983 Apr 21 21:02:14 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:14 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:14 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 Apr 21 21:02:14 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:14 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 1073741824" returned: 0 in 0.541s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:14 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:14 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 Apr 21 21:02:14 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:15 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bfa78848-7fc6-4ee4-a523-45682fe47983" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-bfa78848-7fc6-4ee4-a523-45682fe47983" released by "delete_volume" :: held 1.008s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created reservations ['d1f1c174-f0cc-49e4-9a9f-8f21b22a09a5', '7458bb4f-0ede-45ab-97aa-7595d6b397d0', '86978f1f-96a5-41ca-801e-525f33011e7b', '3e4b2d63-9919-4595-8df1-0646f311f556'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:15 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829" returned: 0 in 0.551s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:15 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:15 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:15 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829 Apr 21 21:02:15 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:15 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" returned: 0 in 0.490s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.212s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd790494-4257-4de1-9d9c-af2ed5057ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d7d99-da49-4b00-8e1a-5cc929377a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Creating offline snapshot ccd56011-9197-42b8-b909-7fe61eb95567 of volume 446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:15 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 (43c4d168-eaa2-48ed-bc4b-f9d624ae2532): created successfully Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d7d99-da49-4b00-8e1a-5cc929377a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (2f11579f-4291-4887-b347-e6045d4e7735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b4cf3e-b61c-42b8-be3c-2eaa8184675c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:15 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-61e0de9b-d356-4109-b8b1-78da83b2ef91 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created volume successfully. Apr 21 21:02:15 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:15 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:15 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68.80be0630-a55c-4093-b75c-350a2fedd829" returned: 0 in 0.455s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:15 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-80be0630-a55c-4093-b75c-350a2fedd829" released by "_delete_snapshot" :: held 2.126s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-bdf33332-7386-4e96-bcea-e108abe85f68" released by "delete_snapshot" :: held 2.146s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:15 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Deleted volume successfully. Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-fce84082-a730-46ca-8724-cdb09767c578 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-bfa78848-7fc6-4ee4-a523-45682fe47983-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Created reservations ['837f083c-70fe-4267-aac8-06971d8438ff', '4f4775b3-89a0-4a86-a4e7-ea4b2cea81fd', '54611ce8-d4e2-4b77-90d8-5b406c940d4e', '33e0079c-43ad-4c31-91d9-76e4ede2bbb5'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:15 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Delete snapshot completed successfully. Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b59809db-5988-4afe-914b-6379d7677545 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-80be0630-a55c-4093-b75c-350a2fedd829-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:15 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.536s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:15 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:15 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 1G Apr 21 21:02:15 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-1f355c36-23a1-422f-bd6f-0cc59b61810f-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-1f355c36-23a1-422f-bd6f-0cc59b61810f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-quobyte-1f355c36-23a1-422f-bd6f-0cc59b61810f" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-1f355c36-23a1-422f-bd6f-0cc59b61810f" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c195e8e-4c87-4c21-a07e-55ad969000c9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:16 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f Apr 21 21:02:16 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:16 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 1G" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446e9b85-f080-4650-88f3-5990c3036d84 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:16 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446e9b85-f080-4650-88f3-5990c3036d84 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 Apr 21 21:02:16 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-bdf33332-7386-4e96-bcea-e108abe85f68-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-bdf33332-7386-4e96-bcea-e108abe85f68-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-bdf33332-7386-4e96-bcea-e108abe85f68" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-bdf33332-7386-4e96-bcea-e108abe85f68" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c130b81-89ef-44cb-ab64-11d470b047dc]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:16 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:02:16 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:16 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f" returned: 0 in 0.548s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:16 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f Apr 21 21:02:16 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:16 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446e9b85-f080-4650-88f3-5990c3036d84 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:16 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 is being set with open permissions: ugo+rw Apr 21 21:02:16 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:16 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 Apr 21 21:02:16 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:17 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.453s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:17 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68 Apr 21 21:02:17 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:17 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f355c36-23a1-422f-bd6f-0cc59b61810f" returned: 0 in 0.475s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-1f355c36-23a1-422f-bd6f-0cc59b61810f" released by "delete_volume" :: held 1.044s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created reservations ['852c1483-510a-4de8-b47d-9e44d06546cb', 'd499e4a7-213b-4ebd-ab57-1478643b06f4', '19c39431-fd8c-45b1-b8eb-7dad4f7691d6', '4f9d5fcf-5fed-4e92-a406-95036f958d06'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:17 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:17 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:17 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:17 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info Apr 21 21:02:17 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:17 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-bdf33332-7386-4e96-bcea-e108abe85f68" returned: 0 in 0.479s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-bdf33332-7386-4e96-bcea-e108abe85f68" released by "delete_volume" :: held 0.962s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Created reservations ['c9c34575-a441-43e3-a355-b4de835fa43d', 'b1da01b6-a6a3-4ed2-995a-bedd399eced4', '99cc9fef-9e59-4b46-a7d0-54cef12b8401', '9ffd349b-be8b-41b9-94ff-61d1eed0debc'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:17 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:17 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:17 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:17 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info" returned: 0 in 0.474s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:17 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info is being set with open permissions: ugo+rw Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:17 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Deleted volume successfully. Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-327e1f2d-b98b-4111-84cb-1852f6078d11 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-1f355c36-23a1-422f-bd6f-0cc59b61810f-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:17 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info Apr 21 21:02:17 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (2a99568b-d217-4731-8aae-2a44ac8b2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4acfff6-e53b-4ff9-864c-442374950b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4acfff6-e53b-4ff9-864c-442374950b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-271603067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb3fc3b-db12-4803-b567-b0481616be4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064cfac743ec4bb1ae3d2d9d032975b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:18Z,use_quota=True,user_id='ee8a037afe6b46b4a188eb61b6642a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd745ec8-1e89-4ea4-ba04-a3d673554d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd745ec8-1e89-4ea4-ba04-a3d673554d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b756a2b7-2742-4001-9847-54e46a6e7d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:17 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b756a2b7-2742-4001-9847-54e46a6e7d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb3fc3b-db12-4803-b567-b0481616be4e', 'volume_name': 'volume-9bb3fc3b-db12-4803-b567-b0481616be4e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635e750f-48d4-42c6-98eb-e2ed25bf0e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635e750f-48d4-42c6-98eb-e2ed25bf0e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f52deed-3781-42bf-9eb2-65c9e73d2c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:18 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Volume 9bb3fc3b-db12-4803-b567-b0481616be4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb3fc3b-db12-4803-b567-b0481616be4e', 'volume_size': 1} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:18 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:18 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Deleted volume successfully. Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-8056a467-0270-4f0c-a5fc-f54f5e784109 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-bdf33332-7386-4e96-bcea-e108abe85f68-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-6a49f802-7d1a-45a6-bb0b-317b89b69dc3-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-6a49f802-7d1a-45a6-bb0b-317b89b69dc3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-quobyte-6a49f802-7d1a-45a6-bb0b-317b89b69dc3" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-6a49f802-7d1a-45a6-bb0b-317b89b69dc3" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:18 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.info" returned: 0 in 0.532s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8417627c-1b20-490f-b3f4-83b6e8814548]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.727s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating offline snapshot 811a2806-be3b-441a-ba22-e8a211263bb2 of volume 43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:18 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-fb8b038b-d582-43ec-99cb-c8042c5a7e2c tempest-SnapshotDependencyTests-1569109630 None] Create snapshot completed successfully Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[230eb0f0-3013-48b6-b89a-190940c143ea]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:18 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 Apr 21 21:02:18 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:18 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 Apr 21 21:02:18 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:18 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3" returned: 0 in 0.493s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:18 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3 Apr 21 21:02:18 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:18 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" returned: 0 in 0.515s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:18 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:19 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 1G Apr 21 21:02:19 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:19 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6a49f802-7d1a-45a6-bb0b-317b89b69dc3" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-6a49f802-7d1a-45a6-bb0b-317b89b69dc3" released by "delete_volume" :: held 1.030s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created reservations ['f7ca9b4a-a9cd-492e-9067-a5e9082d3608', '8a1c1278-66cc-4184-8bff-9d3e941ab9bd', '611ea912-75e0-4001-b878-de2dcfc8845b', '83c38cdf-54a6-43f8-a5d9-c8db6a9abf10'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:19 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 1G" returned: 0 in 0.565s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:19 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:19 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:19 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 Apr 21 21:02:19 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Flow 'volume_create_manager' (c1d156d2-bf82-4756-891e-157fb7b36df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554d3433-cb89-477b-913d-e4252d8827ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554d3433-cb89-477b-913d-e4252d8827ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b95020-0409-4f46-9c32-0923a31c9e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4c867015c4ebb905a0adc41602d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ccd56011-9197-42b8-b909-7fe61eb95567,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='08187d5cb5df45d9ba946e5f97e84033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179f3b5d-9cd3-40d7-8948-5e2822ad0ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179f3b5d-9cd3-40d7-8948-5e2822ad0ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98a3581-95c1-4b5e-aade-dee4f88d1136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98a3581-95c1-4b5e-aade-dee4f88d1136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03b95020-0409-4f46-9c32-0923a31c9e96', 'volume_name': 'volume-03b95020-0409-4f46-9c32-0923a31c9e96', 'volume_size': 1, 'snapshot_id': 'ccd56011-9197-42b8-b909-7fe61eb95567'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a596a426-2e71-455a-bc2b-003e540f3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a596a426-2e71-455a-bc2b-003e540f3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f0b960-889a-4b26-a2f6-3390e9e66d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Volume 03b95020-0409-4f46-9c32-0923a31c9e96: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03b95020-0409-4f46-9c32-0923a31c9e96', 'volume_size': 1, 'snapshot_id': 'ccd56011-9197-42b8-b909-7fe61eb95567'} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:19 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:19 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:19 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Deleted volume successfully. Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-f7599e96-84b5-4526-90b9-eb8c1c5ac711 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-6a49f802-7d1a-45a6-bb0b-317b89b69dc3-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:20 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2" returned: 0 in 0.527s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:20 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 is being set with open permissions: ugo+rw Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:20 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 Apr 21 21:02:20 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:20 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2" returned: 0 in 0.426s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-67e8077b-48d0-4b9d-acff-b8877daf48d9-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:20 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info Apr 21 21:02:20 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-67e8077b-48d0-4b9d-acff-b8877daf48d9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "cinder-quobyte-67e8077b-48d0-4b9d-acff-b8877daf48d9" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-67e8077b-48d0-4b9d-acff-b8877daf48d9" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d75f0-688f-45be-bf01-0db2a65aad72]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:20 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 Apr 21 21:02:20 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:20 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:20 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info is being set with open permissions: ugo+rw Apr 21 21:02:20 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:21 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info Apr 21 21:02:21 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:21 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9" returned: 0 in 0.526s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:21 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9 Apr 21 21:02:21 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:21 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.info" returned: 0 in 0.439s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.009s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.430s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-271603067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb3fc3b-db12-4803-b567-b0481616be4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064cfac743ec4bb1ae3d2d9d032975b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:18Z,use_quota=True,user_id='ee8a037afe6b46b4a188eb61b6642a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Creating volume 9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:21 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:21 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4694ff2f-19bb-4cba-8d18-08127f808e08 tempest-CreateVolumesFromSnapshotTest-874215268 None] Create snapshot completed successfully Apr 21 21:02:21 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e 1073741824 Apr 21 21:02:21 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:21 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-67e8077b-48d0-4b9d-acff-b8877daf48d9" returned: 0 in 0.433s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-quobyte-67e8077b-48d0-4b9d-acff-b8877daf48d9" released by "delete_volume" :: held 0.992s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Created reservations ['3050faa9-bf6a-43bd-a647-141ce54156d2', '58ba60c4-b850-452d-866b-2c66a690ba4f', '8762c3af-def3-42f6-bf57-c56619824285', 'd3d1c267-2ce8-45a4-a748-24ba2741af3f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:21 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:21 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:21 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:22 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e 1073741824" returned: 0 in 0.578s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:22 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:22 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (7ca27d3e-2bc7-4806-881d-82310a19d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea424ee-2446-491f-942b-d0722b76209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea424ee-2446-491f-942b-d0722b76209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295862650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43694e1-06a1-4bb4-a773-293627b6f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:22Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedebd9d-5544-4d4e-8d20-6392d8373d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedebd9d-5544-4d4e-8d20-6392d8373d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f4e84b-c86c-4c46-b128-244c181c76ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f4e84b-c86c-4c46-b128-244c181c76ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f43694e1-06a1-4bb4-a773-293627b6f24c', 'volume_name': 'volume-f43694e1-06a1-4bb4-a773-293627b6f24c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc80e54b-2b36-4bf2-92a8-0c4a8c814e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc80e54b-2b36-4bf2-92a8-0c4a8c814e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e659893c-1e31-4b99-bd52-aedc920b5174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume f43694e1-06a1-4bb4-a773-293627b6f24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f43694e1-06a1-4bb4-a773-293627b6f24c', 'volume_size': 1} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.601s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Deleted volume successfully. Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-acbe7058-fb01-4323-aeaa-100d64dae607 tempest-CreateVolumesFromSourceVolumeTest-794863278 None] Lock "cinder-67e8077b-48d0-4b9d-acff-b8877daf48d9-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (3eaf5ce1-ebff-41df-91f7-3dde96e0b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560e607c-e279-419c-8ef1-d85b7b6a59c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560e607c-e279-419c-8ef1-d85b7b6a59c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663608421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f38a01-7ea4-419b-a4d5-ae44e5642ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:22Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d00bde-88f8-4d5a-8dfe-e85091d4f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d00bde-88f8-4d5a-8dfe-e85091d4f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e585867-cf02-4acb-9880-e4ae1d392373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e585867-cf02-4acb-9880-e4ae1d392373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f38a01-7ea4-419b-a4d5-ae44e5642ca8', 'volume_name': 'volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839ee3e9-a90d-45c0-8d78-ff55d40820fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839ee3e9-a90d-45c0-8d78-ff55d40820fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aba53d8-e537-4529-870f-718e33011cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume 78f38a01-7ea4-419b-a4d5-ae44e5642ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8', 'volume_size': 1} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:22 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (f5ab188b-650f-4d89-be33-ea7e97884741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33128ba-ad35-4db5-a8dc-8c729e023354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.580s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.874s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-quobyte-ccd56011-9197-42b8-b909-7fe61eb95567-03b95020-0409-4f46-9c32-0923a31c9e96" by "_create_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33128ba-ad35-4db5-a8dc-8c729e023354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2113642224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f548491-19e8-497d-bb48-4560d97edb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:23Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bcd0be-4b76-45ba-9c97-f4d2e054ffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bcd0be-4b76-45ba-9c97-f4d2e054ffc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc09e0e-94f1-4ea6-8d27-7f1611b6d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc09e0e-94f1-4ea6-8d27-7f1611b6d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f548491-19e8-497d-bb48-4560d97edb86', 'volume_name': 'volume-1f548491-19e8-497d-bb48-4560d97edb86', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9988856-ba76-40f7-b5e6-a9b10c18d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9988856-ba76-40f7-b5e6-a9b10c18d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00f0fbf-88ea-40c8-994a-c616f7606308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume 1f548491-19e8-497d-bb48-4560d97edb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f548491-19e8-497d-bb48-4560d97edb86', 'volume_size': 1} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f52deed-3781-42bf-9eb2-65c9e73d2c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb3fc3b-db12-4803-b567-b0481616be4e', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f2a0a9-81c2-406a-b102-8154b3ac4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Volume volume-9bb3fc3b-db12-4803-b567-b0481616be4e (9bb3fc3b-db12-4803-b567-b0481616be4e): created successfully Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f2a0a9-81c2-406a-b102-8154b3ac4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (2a99568b-d217-4731-8aae-2a44ac8b2985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-ccd56011-9197-42b8-b909-7fe61eb95567-03b95020-0409-4f46-9c32-0923a31c9e96" acquired by "_create_volume_from_snapshot" :: waited 0.080s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Creating volume 03b95020-0409-4f46-9c32-0923a31c9e96 from snapshot ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-quobyte-03b95020-0409-4f46-9c32-0923a31c9e96" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-1a6830de-5acb-458c-a2c2-57aad4206711 tempest-VolumeDependencyTests-1460809960 None] Created volume successfully. Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-03b95020-0409-4f46-9c32-0923a31c9e96" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] snapshot: ccd56011-9197-42b8-b909-7fe61eb95567, volume: 03b95020-0409-4f46-9c32-0923a31c9e96, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebdef0-66aa-4f4c-80e1-00fcac34181e]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (62aecc78-81d2-40cc-aa29-b7127df8b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aaa883-55f1-49c5-9763-5b26447df0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aaa883-55f1-49c5-9763-5b26447df0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280706563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095dd166-6fe8-4335-90c3-dba3a2e680cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:23Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36f64b-3bc4-4e01-872d-d20eab61105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d36f64b-3bc4-4e01-872d-d20eab61105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae8cac1-047c-4aab-870b-bcbe125177d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae8cac1-047c-4aab-870b-bcbe125177d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095dd166-6fe8-4335-90c3-dba3a2e680cf', 'volume_name': 'volume-095dd166-6fe8-4335-90c3-dba3a2e680cf', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0369933b-4331-4d49-b13c-1f08f0f22ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0369933b-4331-4d49-b13c-1f08f0f22ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e015b9a4-6bdc-4ec3-bc59-b19ee2ffac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume 095dd166-6fe8-4335-90c3-dba3a2e680cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095dd166-6fe8-4335-90c3-dba3a2e680cf', 'volume_size': 1} Apr 21 21:02:22 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 Apr 21 21:02:22 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (15c18e10-b282-46e5-9289-c91035bc5627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0bf736-90ca-403b-b0e8-07893869dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0bf736-90ca-403b-b0e8-07893869dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466333854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb4661d-8222-4132-bed3-9abe006d4efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:23Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbe9528-3931-4357-b034-785734dc6455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbe9528-3931-4357-b034-785734dc6455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51692dbc-5aa1-4e5f-85fd-43ce8bee3a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51692dbc-5aa1-4e5f-85fd-43ce8bee3a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddb4661d-8222-4132-bed3-9abe006d4efa', 'volume_name': 'volume-ddb4661d-8222-4132-bed3-9abe006d4efa', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9f4a6a-ba2d-48c1-bbf5-50089750241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9f4a6a-ba2d-48c1-bbf5-50089750241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937332e5-0ef0-4050-8758-1a4f35a2e665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume ddb4661d-8222-4132-bed3-9abe006d4efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddb4661d-8222-4132-bed3-9abe006d4efa', 'volume_size': 1} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:23 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567" returned: 0 in 0.668s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-446e9b85-f080-4650-88f3-5990c3036d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29c335-8022-4dd8-98b4-33836fe9d7b2]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (8fc99fb4-bc56-4bad-ad4f-e5906500bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:23 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:23 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c5e278-aab0-4568-bb46-25a171d28718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c5e278-aab0-4568-bb46-25a171d28718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1930917441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c7043d-fda0-45ca-a9d5-a1171f74f4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064cfac743ec4bb1ae3d2d9d032975b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9bb3fc3b-db12-4803-b567-b0481616be4e,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:24Z,use_quota=True,user_id='ee8a037afe6b46b4a188eb61b6642a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90cf794-c510-48b6-9c59-f842448482e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90cf794-c510-48b6-9c59-f842448482e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b5ed02-1392-4f62-80ef-6ea43fc8d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b5ed02-1392-4f62-80ef-6ea43fc8d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3c7043d-fda0-45ca-a9d5-a1171f74f4bf', 'volume_name': 'volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf', 'volume_size': 1, 'source_volid': '9bb3fc3b-db12-4803-b567-b0481616be4e', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dee020-0aeb-4e2d-9880-9f87113b2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dee020-0aeb-4e2d-9880-9f87113b2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e81cd59-6fbc-42f0-ae21-11fca7186a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Volume a3c7043d-fda0-45ca-a9d5-a1171f74f4bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf', 'volume_size': 1, 'source_volid': '9bb3fc3b-db12-4803-b567-b0481616be4e', 'source_volstatus': 'available'} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:23 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.523s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:02:23 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:24 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 Apr 21 21:02:24 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Flow 'volume_create_manager' (8d65f716-059c-432c-9e6e-1e652bb1dd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34e2647-6273-49cf-9d8a-a0ac462e66cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34e2647-6273-49cf-9d8a-a0ac462e66cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea0aa16-c77b-46b6-891a-e0e60fca157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a781eaa6864d898a67a662c1b69231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:25Z,use_quota=True,user_id='38da87aa18654984a7c729811a09cca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee80cf3-b0ad-49e1-8a4c-9f435120a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee80cf3-b0ad-49e1-8a4c-9f435120a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0917b04e-20cc-44bd-91f2-c2c848b89b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0917b04e-20cc-44bd-91f2-c2c848b89b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea0aa16-c77b-46b6-891a-e0e60fca157c', 'volume_name': 'volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da09c9d-f376-443e-bc4a-a7309a33c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:24 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da09c9d-f376-443e-bc4a-a7309a33c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:25 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ff3792-60bf-4768-b866-de5c903eaf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:25 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Volume 6ea0aa16-c77b-46b6-891a-e0e60fca157c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c', 'volume_size': 1} Apr 21 21:02:25 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:26 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96" returned: 0 in 2.262s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:26 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54c2dd-e25e-4497-a999-7aac9f3adc94]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:26 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:26 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:26 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.622s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:26 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:02:26 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Converted 1024.00 MB image at 452.61 MB/s Apr 21 21:02:26 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 is being set with open permissions: ugo+rw Apr 21 21:02:26 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:26 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 Apr 21 21:02:26 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:27 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96" returned: 0 in 0.429s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-03b95020-0409-4f46-9c32-0923a31c9e96" released by "_copy_volume_from_snapshot" :: held 4.577s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-ccd56011-9197-42b8-b909-7fe61eb95567-03b95020-0409-4f46-9c32-0923a31c9e96" released by "_create_volume_from_snapshot" :: held 4.597s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.679s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.083s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295862650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43694e1-06a1-4bb4-a773-293627b6f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:22Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating volume f43694e1-06a1-4bb4-a773-293627b6f24c {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:27 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:27 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c 1073741824 Apr 21 21:02:27 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f0b960-889a-4b26-a2f6-3390e9e66d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b95020-0409-4f46-9c32-0923a31c9e96', 'volume_size': 1, 'snapshot_id': 'ccd56011-9197-42b8-b909-7fe61eb95567'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc36ae8-6498-4691-aaa6-00c24fe76406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:27 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Volume volume-03b95020-0409-4f46-9c32-0923a31c9e96 (03b95020-0409-4f46-9c32-0923a31c9e96): created successfully Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc36ae8-6498-4691-aaa6-00c24fe76406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Flow 'volume_create_manager' (c1d156d2-bf82-4756-891e-157fb7b36df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:27 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-827faabd-2e4c-468f-8cac-0a214fbd717b tempest-SnapshotDependencyTests-1569109630 None] Created volume successfully. Apr 21 21:02:27 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c 1073741824" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:27 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:27 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c Apr 21 21:02:27 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c" returned: 0 in 0.437s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.859s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663608421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f38a01-7ea4-419b-a4d5-ae44e5642ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:22Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating volume 78f38a01-7ea4-419b-a4d5-ae44e5642ca8 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:28 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-ccd56011-9197-42b8-b909-7fe61eb95567-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:28 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 1073741824 Apr 21 21:02:28 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e659893c-1e31-4b99-bd52-aedc920b5174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f43694e1-06a1-4bb4-a773-293627b6f24c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00c7917-90f4-4e7e-ae7e-7c5a20b62d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-ccd56011-9197-42b8-b909-7fe61eb95567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-quobyte-446e9b85-f080-4650-88f3-5990c3036d84" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:28 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume volume-f43694e1-06a1-4bb4-a773-293627b6f24c (f43694e1-06a1-4bb4-a773-293627b6f24c): created successfully Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00c7917-90f4-4e7e-ae7e-7c5a20b62d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (7ca27d3e-2bc7-4806-881d-82310a19d856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-446e9b85-f080-4650-88f3-5990c3036d84" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-quobyte-ccd56011-9197-42b8-b909-7fe61eb95567" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:28 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8b92ebb5-f240-4510-bb51-2910ee546b4a tempest-CreateVolumesFromSnapshotTest-874215268 None] Created volume successfully. Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-ccd56011-9197-42b8-b909-7fe61eb95567" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Deleting offline snapshot ccd56011-9197-42b8-b909-7fe61eb95567 of volume 446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] snapshot_file for this snap is: volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daeb2dd-9c64-463f-b3ef-f534764852ad]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:28 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 Apr 21 21:02:28 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 1073741824" returned: 0 in 0.549s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:28 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 Apr 21 21:02:28 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567" returned: 0 in 0.531s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:28 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-446e9b85-f080-4650-88f3-5990c3036d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa04b54-61c1-49f4-9ade-a264a882566d]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:29 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8" returned: 0 in 0.419s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.666s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2113642224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f548491-19e8-497d-bb48-4560d97edb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:23Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating volume 1f548491-19e8-497d-bb48-4560d97edb86 {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:29 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aba53d8-e537-4529-870f-718e33011cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf83bb54-9ce4-49d2-9204-4476c2d47e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:29 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 (78f38a01-7ea4-419b-a4d5-ae44e5642ca8): created successfully Apr 21 21:02:29 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 1073741824 Apr 21 21:02:29 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf83bb54-9ce4-49d2-9204-4476c2d47e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (3eaf5ce1-ebff-41df-91f7-3dde96e0b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:29 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-8cf0c304-6bdd-4526-938e-1d0e29ec5f68 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created volume successfully. Apr 21 21:02:29 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.520s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 Apr 21 21:02:29 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 1073741824" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 Apr 21 21:02:29 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:30 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567" returned: 0 in 0.516s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:30 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567 Apr 21 21:02:30 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:30 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86" returned: 0 in 0.424s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.468s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280706563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095dd166-6fe8-4335-90c3-dba3a2e680cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:23Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating volume 095dd166-6fe8-4335-90c3-dba3a2e680cf {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:30 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00f0fbf-88ea-40c8-994a-c616f7606308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f548491-19e8-497d-bb48-4560d97edb86', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07325d84-7161-402b-915c-4fd484eca577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:30 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf 1073741824 Apr 21 21:02:30 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:30 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume volume-1f548491-19e8-497d-bb48-4560d97edb86 (1f548491-19e8-497d-bb48-4560d97edb86): created successfully Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07325d84-7161-402b-915c-4fd484eca577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (f5ab188b-650f-4d89-be33-ea7e97884741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:30 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0d0bec6b-008e-4c24-b3d6-94335c21acf8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created volume successfully. Apr 21 21:02:30 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84.ccd56011-9197-42b8-b909-7fe61eb95567" returned: 0 in 0.469s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-ccd56011-9197-42b8-b909-7fe61eb95567" released by "_delete_snapshot" :: held 2.108s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-446e9b85-f080-4650-88f3-5990c3036d84" released by "delete_snapshot" :: held 2.125s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Created reservations ['2bb283d5-8a64-45ce-bd9e-22f27542af61', 'd1cd23a0-6506-4e2b-806b-b9b555d26fd5', 'd6b6d143-4c6f-4187-8731-384521bef847', '58ee1e50-b8d2-4994-95da-8a36835e22a9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:30 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Delete snapshot completed successfully. Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-6faa4f2c-b884-449e-b8d1-8c52a79d13be tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-ccd56011-9197-42b8-b909-7fe61eb95567-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:30 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf 1073741824" returned: 0 in 0.571s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf Apr 21 21:02:31 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:31 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.338s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466333854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb4661d-8222-4132-bed3-9abe006d4efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f0becf74340afa9a14e11a56fad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:23Z,use_quota=True,user_id='acc198e7a38b48f987967e43f7637459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Creating volume ddb4661d-8222-4132-bed3-9abe006d4efa {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:31 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e015b9a4-6bdc-4ec3-bc59-b19ee2ffac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095dd166-6fe8-4335-90c3-dba3a2e680cf', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:31 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa 1073741824 Apr 21 21:02:31 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9f361-8a28-456e-a229-a6d159080127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:31 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume volume-095dd166-6fe8-4335-90c3-dba3a2e680cf (095dd166-6fe8-4335-90c3-dba3a2e680cf): created successfully Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9f361-8a28-456e-a229-a6d159080127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (62aecc78-81d2-40cc-aa29-b7127df8b13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:31 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-2ae5d73b-5f28-4d9e-b1d3-9255561c6522 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created volume successfully. Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-446e9b85-f080-4650-88f3-5990c3036d84-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-446e9b85-f080-4650-88f3-5990c3036d84-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-quobyte-446e9b85-f080-4650-88f3-5990c3036d84" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-446e9b85-f080-4650-88f3-5990c3036d84" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b30392-a56f-4f43-8e5a-73e6328fcf4c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:31 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:31 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa 1073741824" returned: 0 in 0.556s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:31 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa Apr 21 21:02:32 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.522s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84 Apr 21 21:02:32 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa" returned: 0 in 0.394s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.752s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:32 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Cloning volume 9bb3fc3b-db12-4803-b567-b0481616be4e to volume a3c7043d-fda0-45ca-a9d5-a1171f74f4bf Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=178,cinder:DELETE=18,cinder:UPDATE=186,cinder:INSERT=40 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937332e5-0ef0-4050-8758-1a4f35a2e665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb4661d-8222-4132-bed3-9abe006d4efa', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f196bbf-d30a-416f-8eb6-e8abe4d9db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:32 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Volume volume-ddb4661d-8222-4132-bed3-9abe006d4efa (ddb4661d-8222-4132-bed3-9abe006d4efa): created successfully Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f196bbf-d30a-416f-8eb6-e8abe4d9db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Flow 'volume_create_manager' (15c18e10-b282-46e5-9289-c91035bc5627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Creating offline snapshot 2f34ec50-cfb2-44db-bd22-b720e734d789 of volume 9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:32 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e16df9e5-9eef-44b2-b84c-2514fc1cbee4 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created volume successfully. Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5164091-79c4-468f-9fa6-a7d436381145]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-446e9b85-f080-4650-88f3-5990c3036d84" returned: 0 in 0.400s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-446e9b85-f080-4650-88f3-5990c3036d84" released by "delete_volume" :: held 0.951s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Created reservations ['bb375b3a-9c34-4472-a29d-cb4b62bfe2de', '2a326152-7990-4077-9551-5bad05dd366a', '9752dee0-b923-49c3-95eb-18fb420c7377', '258a1973-4064-453f-9f9c-3809fa4a4f05'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:32 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:32 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-03b95020-0409-4f46-9c32-0923a31c9e96-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:32 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:32 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-03b95020-0409-4f46-9c32-0923a31c9e96-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "cinder-quobyte-03b95020-0409-4f46-9c32-0923a31c9e96" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-03b95020-0409-4f46-9c32-0923a31c9e96" acquired by "delete_volume" :: waited 0.014s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f38540e-3c06-485f-834d-9b518c6e8c31]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-ddb4661d-8222-4132-bed3-9abe006d4efa-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-ddb4661d-8222-4132-bed3-9abe006d4efa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-ddb4661d-8222-4132-bed3-9abe006d4efa" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-ddb4661d-8222-4132-bed3-9abe006d4efa" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f7e72a-559b-444e-8b19-2aa1564f246b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:32 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 Apr 21 21:02:32 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa Apr 21 21:02:32 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.499s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:33 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Deleted volume successfully. Apr 21 21:02:33 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.673s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-691a138d-886c-4d95-9113-c64036b88a80 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-446e9b85-f080-4650-88f3-5990c3036d84-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:33 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 1G Apr 21 21:02:33 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96" returned: 0 in 0.505s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96 Apr 21 21:02:33 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa" returned: 0 in 0.518s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa Apr 21 21:02:33 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 1G" returned: 0 in 0.483s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb3fc3b-db12-4803-b567-b0481616be4e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb3fc3b-db12-4803-b567-b0481616be4e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 Apr 21 21:02:33 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-03b95020-0409-4f46-9c32-0923a31c9e96" returned: 0 in 0.442s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-quobyte-03b95020-0409-4f46-9c32-0923a31c9e96" released by "delete_volume" :: held 1.004s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Created reservations ['19dec9e9-010c-4128-b04b-16c89e9c09f6', '2eeb1a86-6180-4745-9465-919fe9938596', 'bac5e882-7ecc-4ab6-a364-03f913604414', '19fb2e66-d62d-4360-8fb5-545d1bc8cd66'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-ddb4661d-8222-4132-bed3-9abe006d4efa" returned: 0 in 0.440s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-ddb4661d-8222-4132-bed3-9abe006d4efa" released by "delete_volume" :: held 0.995s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:33 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:33 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['7f6a2aa5-3f44-4c84-b57d-3f7a255fc7c4', 'c02a4857-4f82-4e8c-928c-5a5b114c78ef', 'e6d7fdae-4f93-400e-8282-ac31e769932d', 'f81c4089-2af1-4f54-85ee-570caa552ca2'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:33 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-095dd166-6fe8-4335-90c3-dba3a2e680cf-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:33 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-095dd166-6fe8-4335-90c3-dba3a2e680cf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-095dd166-6fe8-4335-90c3-dba3a2e680cf" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-095dd166-6fe8-4335-90c3-dba3a2e680cf" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe6ddeb-c541-4c8f-b7d2-2b70b5b5c696]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf Apr 21 21:02:34 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:34 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb3fc3b-db12-4803-b567-b0481616be4e -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789" returned: 0 in 0.555s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 is being set with open permissions: ugo+rw Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 Apr 21 21:02:34 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:34 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Deleted volume successfully. Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d638b272-de05-49ef-89ba-a829415402d0 tempest-SnapshotDependencyTests-1569109630 None] Lock "cinder-03b95020-0409-4f46-9c32-0923a31c9e96-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:34 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.503s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:34 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleted volume successfully. Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-b61f695b-9900-4a0f-93f4-2c305fda3c5d tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-ddb4661d-8222-4132-bed3-9abe006d4efa-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:34 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf" returned: 0 in 0.537s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf Apr 21 21:02:34 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:34 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info Apr 21 21:02:34 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-095dd166-6fe8-4335-90c3-dba3a2e680cf" returned: 0 in 0.441s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-095dd166-6fe8-4335-90c3-dba3a2e680cf" released by "delete_volume" :: held 1.002s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['c56e4651-783a-473a-96b6-a65bc070927b', '98d5bd75-cc94-4cac-9312-8dc12b8c1cae', '62f2639c-7353-4f62-a73f-48549594e5f2', '083cead8-f93f-4751-a24d-94fe2106326f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:35 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info" returned: 0 in 0.484s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:35 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info is being set with open permissions: ugo+rw Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-1f548491-19e8-497d-bb48-4560d97edb86-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-1f548491-19e8-497d-bb48-4560d97edb86-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:35 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info Apr 21 21:02:35 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-1f548491-19e8-497d-bb48-4560d97edb86" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-1f548491-19e8-497d-bb48-4560d97edb86" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ac330-7f08-4dac-b5b3-f3b7a83d691b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 Apr 21 21:02:35 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.575s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:35 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleted volume successfully. Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-ff31eba7-56a8-4e8d-b5ef-3cd1f138983e tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-095dd166-6fe8-4335-90c3-dba3a2e680cf-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:35 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.info" returned: 0 in 0.652s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" by "_copy_volume_from_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] snapshot: 2f34ec50-cfb2-44db-bd22-b720e734d789, volume: a3c7043d-fda0-45ca-a9d5-a1171f74f4bf, {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[099f17f0-9bf2-4907-8206-61ced3ba4e7b]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86" returned: 0 in 0.657s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:35 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 Apr 21 21:02:35 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86 Apr 21 21:02:35 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:36 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-1f548491-19e8-497d-bb48-4560d97edb86" returned: 0 in 0.496s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-1f548491-19e8-497d-bb48-4560d97edb86" released by "delete_volume" :: held 1.193s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['be6dc643-0a15-4978-8c91-f3c96f749f48', '4dbdb8c7-9cb9-4dbc-b269-737f45ce1081', '67bd8508-0dc9-47cc-9731-c1a70d5c3276', '80df72bd-b21c-4793-8406-5dc1a03b2ffd'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:36 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789" returned: 0 in 0.639s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bb3fc3b-db12-4803-b567-b0481616be4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Creating direct copy from snapshot {{(pid=82005) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[883654d7-5415-4fb9-85d7-4aca515cbfa9]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:36 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:36 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:36 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:36 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:36 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.454s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:36 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleted volume successfully. Apr 21 21:02:36 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-81f43353-a0ca-4073-80f3-da2242e39cd6 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-1f548491-19e8-497d-bb48-4560d97edb86-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:37 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.568s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG cinder.utils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Path /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf not found in is_blk_device check {{(pid=82005) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:37 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf Apr 21 21:02:37 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-78f38a01-7ea4-419b-a4d5-ae44e5642ca8-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-78f38a01-7ea4-419b-a4d5-ae44e5642ca8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-78f38a01-7ea4-419b-a4d5-ae44e5642ca8" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-78f38a01-7ea4-419b-a4d5-ae44e5642ca8" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddfa4f5-ba24-4a72-b165-c28ea3237e32]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:37 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:37 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 Apr 21 21:02:37 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:38 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8" returned: 0 in 1.074s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:38 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:38 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8 Apr 21 21:02:38 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" returned: 0 in 2.328s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[29beae8b-b629-48fc-837b-8d9b47dfdd66]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-78f38a01-7ea4-419b-a4d5-ae44e5642ca8" returned: 0 in 0.848s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-78f38a01-7ea4-419b-a4d5-ae44e5642ca8" released by "delete_volume" :: held 1.945s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['5531feab-c497-43b3-8a39-c59daae1972e', 'aad5b722-2fae-47d5-974f-16b2ab168681', 'f5e0c7b4-1605-4c21-91b4-b88237aacb50', '7762298b-c5c3-42b0-a2d7-11c96c7d49b4'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:39 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:39 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:39 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-f43694e1-06a1-4bb4-a773-293627b6f24c-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-f43694e1-06a1-4bb4-a773-293627b6f24c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-f43694e1-06a1-4bb4-a773-293627b6f24c" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-f43694e1-06a1-4bb4-a773-293627b6f24c" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f04f13f-1e62-4e18-a887-2521a254a503]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:39 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c Apr 21 21:02:39 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.521s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:40 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleted volume successfully. Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-d4e6bf37-7593-4a0e-a7da-069b01f7103c tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-78f38a01-7ea4-419b-a4d5-ae44e5642ca8-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:40 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.659s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.image.image_utils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf {{(pid=82005) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:02:40 devstack cinder-volume[82005]: INFO cinder.image.image_utils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Converted 1024.00 MB image at 439.39 MB/s Apr 21 21:02:40 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf is being set with open permissions: ugo+rw Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:40 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf Apr 21 21:02:40 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c" returned: 0 in 0.561s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:40 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c Apr 21 21:02:40 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" returned: 0 in 0.422s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" released by "_copy_volume_from_snapshot" :: held 4.670s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-2f34ec50-cfb2-44db-bd22-b720e734d789" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-2f34ec50-cfb2-44db-bd22-b720e734d789" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Deleting offline snapshot 2f34ec50-cfb2-44db-bd22-b720e734d789 of volume 9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] snapshot_file for this snap is: volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b7d95c-d9ac-4074-bd1d-3eb6f4a2881a]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:40 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 Apr 21 21:02:40 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-f43694e1-06a1-4bb4-a773-293627b6f24c" returned: 0 in 0.446s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-f43694e1-06a1-4bb4-a773-293627b6f24c" released by "delete_volume" :: held 1.029s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['9ecb6e84-592d-4988-ad03-73fd427c282a', '6111e59b-a223-42c6-b43f-0ac8cc2cf572', '8d9d91b6-a781-4688-979b-e91443966743', '420ad29c-60a1-44bf-98da-e964c64dc9f6'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:40 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:40 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:40 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:41 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789" returned: 0 in 0.589s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bb3fc3b-db12-4803-b567-b0481616be4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fbd7e0-a688-447b-8ef6-4b9c6bbec2a7]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:41 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:41 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:41 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.453s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:41 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleted volume successfully. Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-c7a92782-f4da-4dd4-b7f6-b4a83862ed96 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-f43694e1-06a1-4bb4-a773-293627b6f24c-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:41 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.553s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:41 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 Apr 21 21:02:41 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-811a2806-be3b-441a-ba22-e8a211263bb2-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-811a2806-be3b-441a-ba22-e8a211263bb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-811a2806-be3b-441a-ba22-e8a211263bb2" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-811a2806-be3b-441a-ba22-e8a211263bb2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleting offline snapshot 811a2806-be3b-441a-ba22-e8a211263bb2 of volume 43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] snapshot_file for this snap is: volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1855208-65cc-43e4-af2a-d5ea119924e2]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:41 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 Apr 21 21:02:42 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789" returned: 0 in 0.546s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789 Apr 21 21:02:42 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2" returned: 0 in 0.561s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a8d06-300f-4ba1-9e3f-228b9e44e845]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 Apr 21 21:02:42 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e.2f34ec50-cfb2-44db-bd22-b720e734d789" returned: 0 in 0.569s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-2f34ec50-cfb2-44db-bd22-b720e734d789" released by "_delete_snapshot" :: held 2.303s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.436s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.828s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea0aa16-c77b-46b6-891a-e0e60fca157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a781eaa6864d898a67a662c1b69231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:25Z,use_quota=True,user_id='38da87aa18654984a7c729811a09cca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Creating volume 6ea0aa16-c77b-46b6-891a-e0e60fca157c {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:42 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c 1073741824 Apr 21 21:02:42 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e81cd59-6fbc-42f0-ae21-11fca7186a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf', 'volume_size': 1, 'source_volid': '9bb3fc3b-db12-4803-b567-b0481616be4e', 'source_volstatus': 'available'}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4453f9-1dc7-4276-948e-2ac2616ce812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Volume volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf (a3c7043d-fda0-45ca-a9d5-a1171f74f4bf): created successfully Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4453f9-1dc7-4276-948e-2ac2616ce812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Flow 'volume_create_manager' (8fc99fb4-bc56-4bad-ad4f-e5906500bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:42 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4c1b9e63-5aae-48d7-ad81-eb9c7d53c9b0 tempest-VolumeDependencyTests-1460809960 None] Created volume successfully. Apr 21 21:02:43 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" returned: 0 in 0.544s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:43 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 Apr 21 21:02:43 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:43 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c 1073741824" returned: 0 in 0.462s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:43 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c Apr 21 21:02:43 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:43 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2" returned: 0 in 0.463s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:43 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2 Apr 21 21:02:43 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:43 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c" returned: 0 in 0.429s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ff3792-60bf-4768-b866-de5c903eaf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df74788-6a9a-4a29-ba3d-c21dc105bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:43 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Volume volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c (6ea0aa16-c77b-46b6-891a-e0e60fca157c): created successfully Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df74788-6a9a-4a29-ba3d-c21dc105bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Flow 'volume_create_manager' (8d65f716-059c-432c-9e6e-1e652bb1dd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:43 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-3f957a28-9e79-488c-a2f5-1ebf8b7029b4 tempest-CinderUnicodeTest-1987768949 None] Created volume successfully. Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-9bb3fc3b-db12-4803-b567-b0481616be4e-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-9bb3fc3b-db12-4803-b567-b0481616be4e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-9bb3fc3b-db12-4803-b567-b0481616be4e" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-9bb3fc3b-db12-4803-b567-b0481616be4e" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294379a-4bf6-4ea4-a9b4-88185fa99b91]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:43 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532.811a2806-be3b-441a-ba22-e8a211263bb2" returned: 0 in 0.487s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-811a2806-be3b-441a-ba22-e8a211263bb2" released by "_delete_snapshot" :: held 2.115s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" released by "delete_snapshot" :: held 2.140s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:44 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:44 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['93ac25fc-2675-4f0f-bd70-5f1292b3fbc3', '7dcc4684-d84a-4d02-a544-018b89cf6d92', '88c1f91c-7ed3-4c0d-9d4e-ea35d6737ccf', '93ab73a5-7d86-48bb-a8aa-29d67a2a7d18'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:44 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Delete snapshot completed successfully. Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-7f240958-44fc-4aed-a9e8-6bb4020b8892 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-811a2806-be3b-441a-ba22-e8a211263bb2-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82005) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Flow 'volume_create_manager' (91a08992-4599-4b83-a7d1-cbac7d511c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ecced7-6aa2-4610-9618-c4ed478f1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ecced7-6aa2-4610-9618-c4ed478f1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1717074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e746161-0b20-42b3-b882-5494258d9d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a781eaa6864d898a67a662c1b69231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:44Z,use_quota=True,user_id='38da87aa18654984a7c729811a09cca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ce1fe1-4e45-49d5-987a-85fec577c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ce1fe1-4e45-49d5-987a-85fec577c225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34399f90-f0e4-4ff2-b927-79a5da6c602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34399f90-f0e4-4ff2-b927-79a5da6c602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e746161-0b20-42b3-b882-5494258d9d9d', 'volume_name': 'volume-3e746161-0b20-42b3-b882-5494258d9d9d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0999d178-40b9-4c58-8f5c-8e5ecd2afea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0999d178-40b9-4c58-8f5c-8e5ecd2afea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dbf132-44be-4d3b-ac47-4788b4854f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:44 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Volume 3e746161-0b20-42b3-b882-5494258d9d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e746161-0b20-42b3-b882-5494258d9d9d', 'volume_size': 1} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1717074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e746161-0b20-42b3-b882-5494258d9d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a781eaa6864d898a67a662c1b69231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:44Z,use_quota=True,user_id='38da87aa18654984a7c729811a09cca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e8066-60f4-450f-b07d-766a9001466c),volume_type_id=c82e8066-60f4-450f-b07d-766a9001466c)}" {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Creating volume 3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Selected osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 as target Quobyte volume. {{(pid=82005) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:44 devstack cinder-volume[82005]: INFO cinder.volume.drivers.remotefs [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] casted to osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207 Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d 1073741824 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d 1073741824 Apr 21 21:02:44 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.511s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e Apr 21 21:02:44 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d 1073741824" returned: 0 in 0.525s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d Apr 21 21:02:44 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-9bb3fc3b-db12-4803-b567-b0481616be4e" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-9bb3fc3b-db12-4803-b567-b0481616be4e" released by "delete_volume" :: held 0.958s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Created reservations ['edf621c8-7ee8-4ce7-bcb6-5260687c0f08', 'b22ae61a-1c1e-4596-aefc-3a178594d6c1', '4a5295cc-d2d8-4965-ba47-2c33aa4261b2', 'a924f01f-f6e1-4a19-bb87-e208c8b1f719'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:44 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:45 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-43c4d168-eaa2-48ed-bc4b-f9d624ae2532-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-43c4d168-eaa2-48ed-bc4b-f9d624ae2532-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" acquired by "delete_volume" :: waited 0.025s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f4acc4-d7c4-48a8-aa79-20da69bd61f8]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "cinder-quobyte-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055e853-ee64-48c9-8125-09b7c59dbb54]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:45 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf Apr 21 21:02:45 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d" returned: 0 in 0.450s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'} {{(pid=82005) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dbf132-44be-4d3b-ac47-4788b4854f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e746161-0b20-42b3-b882-5494258d9d9d', 'volume_size': 1}' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e412e19-1d4a-406a-858f-6408f519ab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:45 devstack cinder-volume[82005]: INFO cinder.volume.flows.manager.create_volume [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Volume volume-3e746161-0b20-42b3-b882-5494258d9d9d (3e746161-0b20-42b3-b882-5494258d9d9d): created successfully Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e412e19-1d4a-406a-858f-6408f519ab61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82005) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Flow 'volume_create_manager' (91a08992-4599-4b83-a7d1-cbac7d511c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82005) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-10e83863-8fd0-41d4-beb2-45a50aa5199a tempest-CinderUnicodeTest-1987768949 None] Created volume successfully. Apr 21 21:02:45 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 Apr 21 21:02:45 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:45 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Deleted volume successfully. Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-33e53624-5fd7-4a63-8a8b-812a368804ae tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-9bb3fc3b-db12-4803-b567-b0481616be4e-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:45 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" returned: 0 in 0.522s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf Apr 21 21:02:45 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" returned: 0 in 0.471s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532 Apr 21 21:02:45 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" returned: 0 in 0.420s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf" released by "delete_volume" :: held 0.982s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:46 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" returned: 0 in 0.438s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Created reservations ['09257bff-4f64-4708-bd7c-b482ca76ce39', '9d741db8-e6e5-4e86-824c-6a28ea94a5b8', '5fe153c5-c04e-4a2c-a23f-abdf4a203864', '015da173-5391-4aa5-84a1-15760d30b9ef'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-quobyte-43c4d168-eaa2-48ed-bc4b-f9d624ae2532" released by "delete_volume" :: held 0.962s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Created reservations ['f7b5548c-2814-4ce3-b80c-09323c061e2b', 'ad8f79a6-dfd1-47b8-893b-43927b0b52cc', 'bcee66c7-ea35-43ed-bdfd-0a87fc15b97f', '5e449cc2-18fe-4a67-9c2e-d02d16acade9'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:46 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:46 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:46 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Creating offline snapshot aea60c4b-33ab-4fa5-b78d-270e80f33303 of volume 3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d08837-821e-4ec0-9c69-5630d02fcd75]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d Apr 21 21:02:46 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.458s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Deleted volume successfully. Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cae07402-22d7-43f6-ab64-472dcbcb2c33 tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-a3c7043d-fda0-45ca-a9d5-a1171f74f4bf-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:46 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.424s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:46 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Deleted volume successfully. Apr 21 21:02:46 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-cfa89187-f5c3-4e90-be31-8a88025b1de8 tempest-CreateVolumesFromSnapshotTest-874215268 None] Lock "cinder-43c4d168-eaa2-48ed-bc4b-f9d624ae2532-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:47 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d" returned: 0 in 0.481s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 1G {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 1G Apr 21 21:02:47 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-7b5a119a-9f0b-4c01-b631-97c6c8ef4380-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-7b5a119a-9f0b-4c01-b631-97c6c8ef4380-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "cinder-quobyte-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" acquired by "delete_volume" :: waited 0.010s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a6b48e-0fae-4922-bc26-6c9534409e95]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 Apr 21 21:02:47 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 1G" returned: 0 in 0.567s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e746161-0b20-42b3-b882-5494258d9d9d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e746161-0b20-42b3-b882-5494258d9d9d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 Apr 21 21:02:47 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" returned: 0 in 0.646s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380 Apr 21 21:02:48 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e746161-0b20-42b3-b882-5494258d9d9d -F qcow2 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303" returned: 0 in 0.523s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 is being set with open permissions: ugo+rw Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 Apr 21 21:02:48 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" returned: 0 in 0.487s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-quobyte-7b5a119a-9f0b-4c01-b631-97c6c8ef4380" released by "delete_volume" :: held 1.172s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Created reservations ['5fa79742-dbf3-4a43-8efd-7af4391b47be', '1da4ae42-7954-45c4-8159-596e84b16fe4', 'f84ef9dc-b76e-4a46-b6b8-075e00668397', '86106f30-6030-4cef-981a-83d349a9df07'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:48 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303" returned: 0 in 0.464s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info Apr 21 21:02:48 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.391s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:48 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Deleted volume successfully. Apr 21 21:02:48 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-94e8468a-af24-4e17-afb5-6d4aa40eaace tempest-VolumeDependencyTests-1460809960 None] Lock "cinder-7b5a119a-9f0b-4c01-b631-97c6c8ef4380-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:49 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info" returned: 0 in 0.467s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:49 devstack cinder-volume[82005]: WARNING cinder.volume.drivers.remotefs [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info is being set with open permissions: ugo+rw Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:49 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info Apr 21 21:02:49 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:49 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.info" returned: 0 in 0.402s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:49 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-4e9f1d41-7e40-47bc-a06f-af672ba8428c tempest-CinderUnicodeTest-1987768949 None] Create snapshot completed successfully Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-aea60c4b-33ab-4fa5-b78d-270e80f33303-delete_snapshot" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-aea60c4b-33ab-4fa5-b78d-270e80f33303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-quobyte-3e746161-0b20-42b3-b882-5494258d9d9d" by "delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-3e746161-0b20-42b3-b882-5494258d9d9d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-quobyte-aea60c4b-33ab-4fa5-b78d-270e80f33303" by "_delete_snapshot" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-aea60c4b-33ab-4fa5-b78d-270e80f33303" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Deleting offline snapshot aea60c4b-33ab-4fa5-b78d-270e80f33303 of volume 3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] snapshot_file for this snap is: volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 {{(pid=82005) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519cbeb-f44a-41b5-b4d4-5ac6f97c1d0c]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:49 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:49 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 Apr 21 21:02:49 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:50 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303" returned: 0 in 0.524s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:50 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.remotefs [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e746161-0b20-42b3-b882-5494258d9d9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82005) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:50 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc4a0f3-d578-48e1-8c38-3fb5dd074ebd]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:50 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d Apr 21 21:02:50 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:50 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d" returned: 0 in 0.486s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:50 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:50 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 Apr 21 21:02:50 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:51 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303" returned: 0 in 0.449s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:51 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303 Apr 21 21:02:51 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:51 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d.aea60c4b-33ab-4fa5-b78d-270e80f33303" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-aea60c4b-33ab-4fa5-b78d-270e80f33303" released by "_delete_snapshot" :: held 1.926s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-3e746161-0b20-42b3-b882-5494258d9d9d" released by "delete_snapshot" :: held 1.943s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Created reservations ['7425f933-c67e-42dd-bd90-0ed0c03b2d5c', 'a6323917-eba3-4923-b506-5dee9d8c0138', '72a5d1d4-2bbd-401b-b41e-79b0857723dd', '09747d88-ef30-4045-826e-2c497c2b5323'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:51 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Delete snapshot completed successfully. Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-e46e20f7-c6eb-4dcb-ad30-397674f86ef4 tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-aea60c4b-33ab-4fa5-b78d-270e80f33303-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-3e746161-0b20-42b3-b882-5494258d9d9d-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-3e746161-0b20-42b3-b882-5494258d9d9d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-quobyte-3e746161-0b20-42b3-b882-5494258d9d9d" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-3e746161-0b20-42b3-b882-5494258d9d9d" acquired by "delete_volume" :: waited 0.007s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce158a91-ba77-46b5-b936-5231dc9d1fa5]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:51 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:51 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d Apr 21 21:02:51 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d" returned: 0 in 0.468s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:52 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d Apr 21 21:02:52 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-3e746161-0b20-42b3-b882-5494258d9d9d" returned: 0 in 0.399s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-3e746161-0b20-42b3-b882-5494258d9d9d" released by "delete_volume" :: held 0.900s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Created reservations ['deedc394-36c0-4782-8318-59af04e63866', '10802488-d747-4a56-99e8-45d5dffe211b', '09a8b9c6-5d1c-48f2-a192-2cd94a06a542', '1dbf54df-9720-402f-8e41-aa6f6650f721'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:52 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:52 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-6ea0aa16-c77b-46b6-891a-e0e60fca157c-delete_volume" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:52 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-6ea0aa16-c77b-46b6-891a-e0e60fca157c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "cinder-quobyte-6ea0aa16-c77b-46b6-891a-e0e60fca157c" by "delete_volume" {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-6ea0aa16-c77b-46b6-891a-e0e60fca157c" acquired by "delete_volume" :: waited 0.006s {{(pid=82005) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo.privsep.daemon [-] privsep: reply[247fdbe2-46da-48fe-a1bf-e66f674da2fb]: (4, 'qcow2') {{(pid=82992) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:53 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c Apr 21 21:02:53 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:53 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.410s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:53 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Deleted volume successfully. Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-0c92ed31-f88f-4bdd-90c6-2718f674656d tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-3e746161-0b20-42b3-b882-5494258d9d9d-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:53 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c" returned: 0 in 0.466s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:53 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c Apr 21 21:02:53 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:53 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa/volume-6ea0aa16-c77b-46b6-891a-e0e60fca157c" returned: 0 in 0.391s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-quobyte-6ea0aa16-c77b-46b6-891a-e0e60fca157c" released by "delete_volume" :: held 0.876s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.quota [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Created reservations ['be8e39ee-da71-49c2-950c-02f22a06098a', 'a80b4d39-675e-4cf5-82ec-fe000fa92692', '8fa67c75-c697-4f42-8652-5ab4a47684a3', 'd7594da9-62b8-4255-be20-d20088d90a7f'] {{(pid=82005) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207': None} {{(pid=82005) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG cinder.volume.drivers.quobyte [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ce85848e-a930-4e84-8121-f543e0441207'] {{(pid=82005) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.lockutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82005) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:53 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:53 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa Apr 21 21:02:53 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:54 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:54 devstack cinder-volume[82005]: DEBUG oslo_concurrency.processutils [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d31c288f90c614daadd9bb61d62e1fa" returned: 0 in 0.422s {{(pid=82005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:54 devstack cinder-volume[82005]: DEBUG cinder.manager [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Notifying Schedulers of capabilities ... {{(pid=82005) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:54 devstack cinder-volume[82005]: INFO cinder.volume.manager [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Deleted volume successfully. Apr 21 21:02:54 devstack cinder-volume[82005]: DEBUG cinder.coordination [None req-50c9bded-c8de-478f-82b9-9dec684e956f tempest-CinderUnicodeTest-1987768949 None] Lock "cinder-6ea0aa16-c77b-46b6-891a-e0e60fca157c-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=82005) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:03 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=164,cinder:INSERT=76,cinder:UPDATE=250,cinder:DELETE=21 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:03:04 devstack cinder-volume[82005]: DEBUG dbcounter [-] [82005] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=147,cinder:DELETE=10 {{(pid=82005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}